No Dupes in Search Results

If you are experiencing problems with "Everything", post here for assistance.
Post Reply
mihmann
Posts: 6
Joined: Thu Nov 14, 2019 8:57 am

No Dupes in Search Results

Post by mihmann » Thu Nov 14, 2019 9:02 am

Hi... can I ask ... is it possible to get search results with no duplicates in there?

I Have pretty big database with many mp3 files... and sometime I need to find some of them
sometimes my result is several thousands of files and there are only 100 of them are unique....

is there any option to get rid of dupes in result search?

files are located in different folders in my music collection

I would like to see each unique file just one time.... no matter where is it located... it could by any folder in database...

or the file with the newest date modificated

P.S. I know about the command !dupe:

it shows only uniq
But I need uniq + one position of each duplicates
Last edited by mihmann on Thu Nov 14, 2019 10:12 am, edited 1 time in total.

void
Site Admin
Posts: 4983
Joined: Fri Oct 16, 2009 11:31 pm

Re: No Dupes in Search Results

Post by void » Thu Nov 14, 2019 10:00 am

A View option to hide duplicated basenames is on my TODO list.

Thanks for the suggestion.

mihmann
Posts: 6
Joined: Thu Nov 14, 2019 8:57 am

Re: No Dupes in Search Results

Post by mihmann » Thu Nov 14, 2019 10:15 am

Oh, great!

Taking into account to see the master.... I want to get my Admire about your Programm!!


maybe, you can tell me how much time we should wait for this option... maybe approximately...?


P.S. just for the record

the option that I desire is:
the oportunity to see in results - All uniq files + one position of each duplicates

void
Site Admin
Posts: 4983
Joined: Fri Oct 16, 2009 11:31 pm

Re: No Dupes in Search Results

Post by void » Thu Nov 14, 2019 10:20 am

I'm still along way from an Everything 1.5 alpha release sorry.

I'm not sure this feature would make it into the Everything 1.5 release at this stage.

therube
Posts: 2372
Joined: Thu Sep 03, 2009 6:48 pm

Re: No Dupes in Search Results

Post by therube » Sat Nov 16, 2019 3:59 pm

pseudo-code...


[everything] dupe: ext:mp3
export to efu -> mp3dup.efu

[vim] edit mp3dup.efu
%s/.*\\/"/g
-remove everything up through the final / character
>with that the path part of the filenames are removed, leaving only the file name itself [plus the additional data; size, date...]
%s/",.*/"/
-remove everything after the ", sequence, replace it with a "
>at that point, all that is there are the (duplicated) filenames (in quotes) [no additional data; size, date...]
:.,$!uniq -d
-with that, the duplicated names are now deduplicated (so only one of each of the names)
save, named as, mp3ONLY1dup.efu

[everything] !dupe: ext:mp3
export to efu -> mp3notdup.efu

cat mp3dup.efu mp3notdup.efu > uniq+1.efu
- merge the deduped file (names only) & the uniq files together


Open uniq+1.efu in Everything.
You will now have a "deduped" list of your mp3's (file names, at the least).
"Unique" files will have their expected information.
"Deduped" files will only show their file name.
(Deduped will show Path to be the location from which the .efu was opened.
And I'm sure there will be some exceptions & gotchas.)

mihmann
Posts: 6
Joined: Thu Nov 14, 2019 8:57 am

Re: No Dupes in Search Results

Post by mihmann » Wed Nov 27, 2019 11:22 am

It's kind od complicated... but in some cases - useful!
thank you


I also have another question.... How can I search for dupes with no ext matters?
I mean, I need that files that have flac of mp3 extention - EV will find me as dupes

Is that possible??

mihmann
Posts: 6
Joined: Thu Nov 14, 2019 8:57 am

Re: No Dupes in Search Results

Post by mihmann » Wed Nov 27, 2019 11:34 am

for some reasons...
namepartdupe:

doens't show me dupes


I'm trying to understand why...

NotNull
Posts: 1595
Joined: Wed May 24, 2017 9:22 pm

Re: No Dupes in Search Results

Post by NotNull » Wed Nov 27, 2019 2:24 pm

mihmann wrote:
Wed Nov 27, 2019 11:22 am
I also have another question.... How can I search for dupes with no ext matters?
I mean, I need that files that have flac of mp3 extention - EV will find me as dupes
mihmann wrote:
Wed Nov 27, 2019 11:34 am
namepartdupe:
doens't show me dupes
Does this work for you? :
  • Search for
    ext:mp3;flac
  • Choose Menu:File > Export
  • Save as type: EFU Everything File List (*.efu)
  • Open this EFU file through Menu:File > Open File List
  • Search for namepartdupe:
    That should give you a list of all MP3/flac files that have another flac/mp3 file with the same namepart.
  • When done, return to your "regular" Everything with Menu:File > Close File List

Note:
instead of ext:mp3;flac you can also search for audio: to find all kinds of audio files (similar to searching for ext:aac;ac3;aif;aifc;aiff;au;cda;dts;fla;flac;it;m1a;m2a;m3u;m4a;mid;midi;mka;mod;mp2;mp3;mpa;ogg;ra;rmi;spc;rmi;snd;umx;voc;wav;wma;xm)

mihmann
Posts: 6
Joined: Thu Nov 14, 2019 8:57 am

Re: No Dupes in Search Results

Post by mihmann » Wed Nov 27, 2019 3:02 pm

I've done everything

but the command "namepartdupe:"
doesn't show me any results

the window is empty

but in the efu list there are dupes

the command dupe: - works
but I need to find all filename dupes

NotNull
Posts: 1595
Joined: Wed May 24, 2017 9:22 pm

Re: No Dupes in Search Results

Post by NotNull » Wed Nov 27, 2019 3:08 pm

What version of Everything do you use?
You can check this in Menu:Help > About Everything

therube
Posts: 2372
Joined: Thu Sep 03, 2009 6:48 pm

Re: No Dupes in Search Results

Post by therube » Wed Nov 27, 2019 4:19 pm

Create two files.
Say, mihmann.txt & mihmann.doc.

Do a search, namedupepart:

And ?


Any other filters you have enabled that may affect the results (or lack there of)?

NotNull
Posts: 1595
Joined: Wed May 24, 2017 9:22 pm

Re: No Dupes in Search Results

Post by NotNull » Wed Nov 27, 2019 4:47 pm

therube wrote:
Wed Nov 27, 2019 4:19 pm
Any other filters you have enabled that may affect the results
Good point! (might be regex ...)
@mihmann: your search menu should look like this (only Everything enabled):
2019-11-27 17_31_47-Window.png
therube wrote:
Wed Nov 27, 2019 4:19 pm
namedupepart:
That should of course be namepartdupe:
(and dupenamepart: works too)
You do not have the required permissions to view the files attached to this post.

mihmann
Posts: 6
Joined: Thu Nov 14, 2019 8:57 am

Re: No Dupes in Search Results

Post by mihmann » Fri Nov 29, 2019 1:01 pm

thanks!! it works!

Post Reply