800 - Bug in Duplicates File Search - Still an issue in 810

Bugs and issues - current donor version.
Post Reply
Message
Author
Free4all
Posts: 323
Joined: 30.09.2014, 19:12

800 - Bug in Duplicates File Search - Still an issue in 810

#1 Post by Free4all » 14.07.2019, 21:34

FCXE v800 donor on Win7

Search for duplicate files/folders sometimes reports files that have no duplicates as if they do.

I have "Find duplicate files" and "Same content (MD5 sum)" enabled. No other options under "Search criteria" are enabled (except "Same size", which is enabled and dimmed.)

The Search results pane shows a single 57KB text file, and the status bar reports "Found 1 file(s) in 1 group(s)".

It's clearly an error, as FCXE is reporting that it found 1 file, but it should always find at least 2 files if there is a duplicate.

There are 27 files in the folder, ranging in size from 48 bytes to 1.25MB.

There are no actual duplicate files in the folder, despite what FCXE is reporting.
Last edited by Free4all on 06.01.2020, 00:27, edited 2 times in total.

Karol
Posts: 767
Joined: 19.08.2007, 10:05

Re: 800 - Bug in Duplicates File Search

#2 Post by Karol » 17.07.2019, 12:33

Have you created MD5 sum of all files and checked if you can find two same sums?

Free4all
Posts: 323
Joined: 30.09.2014, 19:12

Re: 800 - Bug in Duplicates File Search

#3 Post by Free4all » 21.07.2019, 04:01

Yes, all MD5 checksums are unique.

I found that even simply placing 1 file in a folder, FCXE will often determine it is a duplicate... even though it is the only file.

iwant2know
Posts: 17
Joined: 28.03.2016, 22:20

Re: 800 - Bug in Duplicates File Search

#4 Post by iwant2know » 22.07.2019, 22:00

confirm duplicates not working correctly. it may even crash:
Image
800, seems buggy to me

Free4all
Posts: 323
Joined: 30.09.2014, 19:12

Re: 800 - Bug in Duplicates File Search

#5 Post by Free4all » 04.01.2020, 10:08

The changelog for FCXE release 801 Donor indicated that this bug was fixed.

As of release 808 64-bit Donor, this bug, or a relative of it, is still very present.

Two days ago, I deleted dozens of newly created non-duplicate files because of this bug... only hours before automated backups were run. The end result was much frustration and significant time lost. :cry:

A few hours ago, build 810 64-bit Donor was released. Does it contain any fixes for this issue implemented since the release of 808 64-bit Donor?

Marek
Author
Author
Posts: 2795
Joined: 10.04.2006, 07:48
Location: Germany
Contact:

Re: 800 - Bug in Duplicates File Search - Still an issue in 808

#6 Post by Marek » 04.01.2020, 15:35

A few hours ago, build 810 64-bit Donor was released. Does it contain any fixes for this issue implemented since the release of 808 64-bit Donor?
No.

Please provide exact description how I can reproduce your problem. If possible send me the archive with files for testing.

Free4all
Posts: 323
Joined: 30.09.2014, 19:12

Re: 800 - Bug in Duplicates File Search - Still an issue in 808

#7 Post by Free4all » 05.01.2020, 04:01

Marek wrote:
04.01.2020, 15:35
A few hours ago, build 810 64-bit Donor was released. Does it contain any fixes for this issue implemented since the release of 808 64-bit Donor?
No.

Please provide exact description how I can reproduce your problem. If possible send me the archive with files for testing.
Hi Marek. Happy New Year to you. Thank you for your quick response.

I wish I could send you an archive with the original files, but the files all got deleted due to this issue. :cry:

I'm trying to recreate the issue(s) using different files, and I'm only having partial success.

I've come across 2 issues that should be easy to replicate on your end.

First, a minor issue.

To replicate:
1. Create a folder with 100 files of 10MB each and 2 files of 1GB each. You'll now have 3GB of data.
(To create an empty file of any size, you can use: fsutil file createnew <filename> <size_in_bytes> )
2. Copy the contents of that folder to another folder.
3. Now find duplicate files between those folders using the MD5 comparison option.
4. While it is running, take a look at the output. In the midst of actual files, I see:

Image

You may have to scroll up and down to see it.

It's not a big deal, because it eventually gets cleaned up when the comparison is completely done, but it's a bit odd and disconcerting.

Second, a more serious issue. This one requires a bit of EBKAC, but needs to be handled properly by FCXE.

To replicate:
1. Create a folder named EBKAC1
2. Create a subfolder under EBKAC1 called EBKAC2
3. Open the Search files/folders window and specify folders "..\EBKAC1;..\EBKAC1\EBKAC2".
4. Ensure "Search in subfolders to level" is checked.
5. Now go to the Duplicates tab and select "Find duplicate files" and "Same content (MD5 sum)".
6. Press the Find button.

FCXE will report that all files are duplicates.

Although one could argue that this may be technically correct from a programming point of view, it's clearly not what the user wanted or expected. An individual file should never be compared against itself, because it will always be a duplicate of itself, no matter what comparison options are selected.

Marek
Author
Author
Posts: 2795
Joined: 10.04.2006, 07:48
Location: Germany
Contact:

Re: 800 - Bug in Duplicates File Search - Still an issue in 808

#8 Post by Marek » 05.01.2020, 17:35

The second problem is the search problem. The same files are listed double if you simply start only search.
The specification "..\EBKAC1;..\EBKAC1\EBKAC2" does not make sense if the option "Search in subfolders to level" is active.
I have fixed the problem for the next release.

Free4all
Posts: 323
Joined: 30.09.2014, 19:12

Re: 800 - Bug in Duplicates File Search - Still an issue in 808

#9 Post by Free4all » 06.01.2020, 00:26

Marek wrote:
05.01.2020, 17:35
The second problem is the search problem. The same files are listed double if you simply start only search.
The specification "..\EBKAC1;..\EBKAC1\EBKAC2" does not make sense if the option "Search in subfolders to level" is active.
I have fixed the problem for the next release.
Thank you for fixing it Marek. I look forward to the next release.

What do you think of the first issue mentioned (the one with the partial screenshot provided)?

Post Reply

Who is online

Users browsing this forum: gordynorth and 5 guests