Slow Download Shows A Size of 0

General discussion related to "Everything".
therube
Posts: 1637
Joined: Thu Sep 03, 2009 6:48 pm

Slow Download Shows A Size of 0

Postby therube » Mon Nov 07, 2016 3:14 pm

Don't think I've noticed it before, but I am now, sometimes, with 793/794b, where a Slow Download Shows A file Size of 0-bytes.

Interacting with the file, updates the size - to that point in time, as expected.
Likewise, when the download completes, it again has the expected size at that point.

Maybe I just didn't see it before?
Or there is a behavior change recently?

void
Site Admin
Posts: 3295
Joined: Fri Oct 16, 2009 11:31 pm

Re: Slow Download Shows A Size of 0

Postby void » Tue Nov 08, 2016 5:57 am

Check with Process Explorer to see if there are any open handles to the slow download.

Everything will not update the size of the file until a handle is closed. This limitation is caused by how Everything works with the USN Change Journal.
It might be possible to catch size changes more frequently with monitoring the folders for changes. I'll consider adding an option to do so in a future release.

Maybe I just didn't see it before?
Or there is a behavior change recently?


Depends what download program you use and how it saves to disk.
In most cases you probably don't want the USN journal spammed with thousands of DATA_EXTEND (size change) events.

The NTFS monitors in Everything have not changed.
The same monitoring method from Everything 1.0 is still being used.

If your downloads folder is indexed with folder indexing you may experience a change from Everything 1.3 to Everything 1.4.1. However, Everything 1.4.1 should be catching more file system changes.

therube
Posts: 1637
Joined: Thu Sep 03, 2009 6:48 pm

Re: Slow Download Shows A Size of 0

Postby therube » Wed Dec 21, 2016 1:39 pm

Just noting what I saw ...

Was changing the fps of a movie.

Code: Select all

mencoder.exe  -fps 25  -nosound  -ovc copy  in24.mp4  -o out25.mp4


So as mencoder was running (took a few minutes), it was "streaming" its output to out25.mp4.
At the same time, I was previewing out25.mp4 in MPlayer.

While this was going on, I did not take notice what file size was being reported in Everything.
When mencoder finished, I had expected Everything to show the files correct size, but it didn't.

Knowing that it wasn't right, suspected that either mencoder or MPlayer still had a handle on the file?
AFAICT mencoder was out of the picture at that point - it had finished its work & I was sitting at a C: prompt.

It wasn't until I closed MPlayer that Everything updated the file size to show correctly.


I didn't really expect that - that I'd have to actually close MPlayer before Everything updated.
In the past I've done plenty of similar changes to files (most often using ffmpeg.exe) while at the same time had been "previewing" in MPlayer, but never had Everything failed to update a file size - once the ffmpeg.exe process had finished its work. (IOW, previewing in MPlayer had never hindered a file size update in Everything - that I'm aware of.)

This is my first time using mencoder like this & maybe there is some weird interaction between it & MPlayer so maybe its just a quirk in this circumstance?



Looking at debug, I noticed that...

Before closing MPlayer, file size was wrong.
After closing MPlayer, file size was updated correctly in Everything (GUI),
but I didn't see any indication of a "change" in debug?
So then I changed the search to 'out25.mp44' (appending a second 4),
which returned no results (expected).
Then backed out the second 4, so again 'out25.mp4',
at which time debug then showed the correct file size.

Not sure if there is anything material in the behavior or not?
Once MPlayer closed, Everything GUI had the file size, but I didn't see any reflection of same in debug.
Maybe its just a non-issue.

In any case, not particularly concerned, just mentioning.

Code: Select all

total size 18086468, calculated in 0.000001 seconds
total size 18086468, calculated in 0.000001 seconds
total size 0, calculated in 0.000000 seconds
total size 219419676, calculated in 0.000001 seconds


Code: Select all

Everything
Version 1.4.1.817b (x86)
Windows NT 6.1
Processors 4
IsAdmin 0
AppData 0
Service 1
cmdline "C:\DEV\Locate\Everything.exe" -url "es:ncmain.exe"
WM_ACTIVATE 00000000 00000000, lastfocus 016100a8, current focus 016100a8
WM_ACTIVATE 00000001 00000000, lastfocus 016100a8, current focus 00000000
search 'o' filter 'ext:3g2;3gp;3gp2;3gpp;amr;amv;asf;avi;bdmv;bik;d2v;divx;drc;dsa;dsm;dss;dsv;evo;f4v;flc;fli;flic;flv;hdmov;ifo;iv
f;m1v;m2p;m2t;m2ts;m2v;m4b;m4p;m4v;mkv;mp2v;mp4;mp4v;mpe;mpeg;mpg;mpls;mpv2;mpv4;mov;mts;ogm;ogv;pss;pva;qt;ram;ratdvd;rm;rmm;rmvb;r
oq;rpm;smil;smk;swf;tp;tpr;ts;vob;vp6;webm;wm;wmp;wmv;h264;ra;srt;dtapart;part' sort 0
term 0c533d70, flags: 3140, next: 0cdb8028, notnext: 00000000
folderop: 2, fileop: 2, term: o
term 0cdb8028, flags: 3140, next: 00000000, notnext: 00000000
folderop: 1, fileop: 162, term: ext:3g2;3gp;3gp2;3gpp;amr;amv;asf;avi;bdmv;bik;d2v;divx;drc;dsa;dsm;dss;dsv;evo;f4v;flc;fli;flic;flv
;hdmov;ifo;ivf;m1v;m2p;m2t;m2ts;m2v;m4b;m4p;m4v;mkv;mp2v;mp4;mp4v;mpe;mpeg;mpg;mpls;mpv2;mpv4;mov;mts;ogm;ogv;pss;pva;qt;ram;ratdvd;
rm;rmm;rmvb;roq;rpm;smil;smk;swf;tp;tpr;ts;vob;vp6;webm;wm;wmp;wmv;h264;ra;srt;dtapart;part
SET SORT 0
...
SET SORT 0
found 0 folders, size 0, db search time taken: 0.005065 seconds
found 1 files, size 65540, db search time taken: 0.023635 seconds
total size 18086468, calculated in 0.000001 seconds
set sort 0 1
already sorted
finished sort, time taken 0.000681 seconds
update selection 0.000000 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000128 seconds
new results
search 'out25.mp4' filter 'ext:3g2;3gp;3gp2;3gpp;amr;amv;asf;avi;bdmv;bik;d2v;divx;drc;dsa;dsm;dss;dsv;evo;f4v;flc;fli;flic;flv;hdmo
v;ifo;ivf;m1v;m2p;m2t;m2ts;m2v;m4b;m4p;m4v;mkv;mp2v;mp4;mp4v;mpe;mpeg;mpg;mpls;mpv2;mpv4;mov;mts;ogm;ogv;pss;pva;qt;ram;ratdvd;rm;rm
m;rmvb;roq;rpm;smil;smk;swf;tp;tpr;ts;vob;vp6;webm;wm;wmp;wmv;h264;ra;srt;dtapart;part' sort 0
term 0c5e60e8, flags: 1140, next: 0cdb82f8, notnext: 00000000
folderop: 2, fileop: 2, term: out25.mp4
term 0cdb82f8, flags: 3140, next: 00000000, notnext: 00000000
folderop: 1, fileop: 162, term: ext:3g2;3gp;3gp2;3gpp;amr;amv;asf;avi;bdmv;bik;d2v;divx;drc;dsa;dsm;dss;dsv;evo;f4v;flc;fli;flic;flv
;hdmov;ifo;ivf;m1v;m2p;m2t;m2ts;m2v;m4b;m4p;m4v;mkv;mp2v;mp4;mp4v;mpe;mpeg;mpg;mpls;mpv2;mpv4;mov;mts;ogm;ogv;pss;pva;qt;ram;ratdvd;
rm;rmm;rmvb;roq;rpm;smil;smk;swf;tp;tpr;ts;vob;vp6;webm;wm;wmp;wmv;h264;ra;srt;dtapart;part
SET SORT 0
found 0 folders, size 0, db search time taken: 0.010399 seconds
found 1 files, size 65540, db search time taken: 0.034913 seconds
total size 18086468, calculated in 0.000001 seconds
set sort 0 1
already sorted
finished sort, time taken 0.000583 seconds
update selection 0.000000 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000159 seconds
new results
WM_ACTIVATE 00000000 00000000, lastfocus 016100a8, current focus 016100a8
update m 1 65931544
update index E:
updated E: in 0.000484 seconds
resume ntfs monitor 1
processed usn records in 0.000834 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000720 seconds
WM_ACTIVATE 00000001 00000000, lastfocus 016100a8, current focus 00000000
WM_ACTIVATE 00000000 00000000, lastfocus 016100a8, current focus 016100a8
update m 1 65931544
update index E:
updated E: in 0.000334 seconds
resume ntfs monitor 1
processed usn records in 0.001732 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000149 seconds
update m 1 65931544
update index E:
updated E: in 0.000643 seconds
resume ntfs monitor 1
processed usn records in 0.001013 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000263 seconds
WM_ACTIVATE 00000001 00000000, lastfocus 016100a8, current focus 00000000
WM_ACTIVATE 00000000 00000000, lastfocus 016100a8, current focus 016100a8
WM_DRAWCLIPBOARD 0 1 0
WM_DRAWCLIPBOARD 0 1 0
WM_DRAWCLIPBOARD 0 1 0
WM_DRAWCLIPBOARD 0 1 0
WM_DRAWCLIPBOARD 0 1 0
WM_DRAWCLIPBOARD 0 1 0
WM_DRAWCLIPBOARD 0 1 0
WM_ACTIVATE 00000001 00000000, lastfocus 016100a8, current focus 00000000
WM_ACTIVATE 00000000 00000000, lastfocus 016100a8, current focus 016100a8
update m 0 65931360
update index C:
updated C: in 0.000530 seconds
processed usn records in 0.000283 seconds
resume ntfs monitor 0
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.001509 seconds
new results
new results
update m 1 65931544
update index E:
updated E: in 0.000393 seconds
resume ntfs monitor 1
processed usn records in 0.000704 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000289 seconds
WM_DRAWCLIPBOARD 0 1 0
WM_DRAWCLIPBOARD 0 1 0
WM_DRAWCLIPBOARD 0 1 0
WM_DRAWCLIPBOARD 0 1 0
WM_DRAWCLIPBOARD 0 1 0
WM_DRAWCLIPBOARD 0 1 0
WM_DRAWCLIPBOARD 0 1 0
update m 1 65931544
update index E:
updated E: in 0.000411 seconds
resume ntfs monitor 1
processed usn records in 0.000268 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000186 seconds
update m 0 65931360
update index C:
updated C: in 0.000330 seconds
resume ntfs monitor 0
processed usn records in 0.001707 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000462 seconds
update m 1 65931544
update index E:
updated E: in 0.000300 seconds
resume ntfs monitor 1
processed usn records in 0.000562 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000162 seconds
update m 1 65931544
update index E:
updated E: in 0.000542 seconds
resume ntfs monitor 1
processed usn records in 0.001007 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000164 seconds
update m 1 65931544
update index E:
updated E: in 0.000417 seconds
resume ntfs monitor 1
processed usn records in 0.000287 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000142 seconds
update m 1 65931544
update index E:
updated E: in 0.000396 seconds
resume ntfs monitor 1
processed usn records in 0.000257 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000142 seconds
update m 1 65931544
update index E:
updated E: in 0.000400 seconds
resume ntfs monitor 1
processed usn records in 0.000266 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000157 seconds
update m 0 65931360
update index C:
updated C: in 0.000383 seconds
resume ntfs monitor 0
rename safebrowsing to safebrowsing-backup
parent backup count 0
renamed 0 subfolders and 45 files from safebrowsing in 0.020729 seconds
processed usn records in 0.022149 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000182 seconds
when ready 11 0000002d 00000000
update m 0 65931360
update index C:
updated C: in 0.003309 seconds
resume ntfs monitor 0
rename safebrowsing-backup to safebrowsing-to_delete
parent backup count 0
renamed 0 subfolders and 45 files from safebrowsing-backup in 0.017618 seconds
remove subfolders and files from safebrowsing-to_delete
parent backup count 0
removed 0 subfolders and 0 files from safebrowsing-to_delete in 0.007298 seconds
processed usn records in 0.039311 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000296 seconds
when ready 11 0000002d 00000000
WM_ACTIVATE 00000001 00000000, lastfocus 016100a8, current focus 00000000
search 'out25.mp44' filter 'ext:3g2;3gp;3gp2;3gpp;amr;amv;asf;avi;bdmv;bik;d2v;divx;drc;dsa;dsm;dss;dsv;evo;f4v;flc;fli;flic;flv;hdm
ov;ifo;ivf;m1v;m2p;m2t;m2ts;m2v;m4b;m4p;m4v;mkv;mp2v;mp4;mp4v;mpe;mpeg;mpg;mpls;mpv2;mpv4;mov;mts;ogm;ogv;pss;pva;qt;ram;ratdvd;rm;r
mm;rmvb;roq;rpm;smil;smk;swf;tp;tpr;ts;vob;vp6;webm;wm;wmp;wmv;h264;ra;srt;dtapart;part' sort 0
term 0c5e5c38, flags: 1140, next: 0c59b7a8, notnext: 00000000
folderop: 2, fileop: 2, term: out25.mp44
term 0c59b7a8, flags: 3140, next: 00000000, notnext: 00000000
folderop: 1, fileop: 162, term: ext:3g2;3gp;3gp2;3gpp;amr;amv;asf;avi;bdmv;bik;d2v;divx;drc;dsa;dsm;dss;dsv;evo;f4v;flc;fli;flic;flv
;hdmov;ifo;ivf;m1v;m2p;m2t;m2ts;m2v;m4b;m4p;m4v;mkv;mp2v;mp4;mp4v;mpe;mpeg;mpg;mpls;mpv2;mpv4;mov;mts;ogm;ogv;pss;pva;qt;ram;ratdvd;
rm;rmm;rmvb;roq;rpm;smil;smk;swf;tp;tpr;ts;vob;vp6;webm;wm;wmp;wmv;h264;ra;srt;dtapart;part
SET SORT 0
found 0 folders, size 0, db search time taken: 0.010807 seconds
found 0 files, size 0, db search time taken: 0.028856 seconds
total size 0, calculated in 0.000000 seconds
set sort 0 1
already sorted
finished sort, time taken 0.000262 seconds
update selection 0.000000 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000086 seconds
when ready 11 0000002d 00000000
new results
search 'out25.mp4' filter 'ext:3g2;3gp;3gp2;3gpp;amr;amv;asf;avi;bdmv;bik;d2v;divx;drc;dsa;dsm;dss;dsv;evo;f4v;flc;fli;flic;flv;hdmo
v;ifo;ivf;m1v;m2p;m2t;m2ts;m2v;m4b;m4p;m4v;mkv;mp2v;mp4;mp4v;mpe;mpeg;mpg;mpls;mpv2;mpv4;mov;mts;ogm;ogv;pss;pva;qt;ram;ratdvd;rm;rm
m;rmvb;roq;rpm;smil;smk;swf;tp;tpr;ts;vob;vp6;webm;wm;wmp;wmv;h264;ra;srt;dtapart;part' sort 0
term 0c5e60e8, flags: 1140, next: 0c59b7a8, notnext: 00000000
folderop: 2, fileop: 2, term: out25.mp4
term 0c59b7a8, flags: 3140, next: 00000000, notnext: 00000000
folderop: 1, fileop: 162, term: ext:3g2;3gp;3gp2;3gpp;amr;amv;asf;avi;bdmv;bik;d2v;divx;drc;dsa;dsm;dss;dsv;evo;f4v;flc;fli;flic;flv
;hdmov;ifo;ivf;m1v;m2p;m2t;m2ts;m2v;m4b;m4p;m4v;mkv;mp2v;mp4;mp4v;mpe;mpeg;mpg;mpls;mpv2;mpv4;mov;mts;ogm;ogv;pss;pva;qt;ram;ratdvd;
rm;rmm;rmvb;roq;rpm;smil;smk;swf;tp;tpr;ts;vob;vp6;webm;wm;wmp;wmv;h264;ra;srt;dtapart;part
SET SORT 0
found 0 folders, size 0, db search time taken: 0.012198 seconds
found 1 files, size 65540, db search time taken: 0.034224 seconds
total size 219419676, calculated in 0.000001 seconds
set sort 0 1
already sorted
finished sort, time taken 0.000444 seconds
update selection 0.000000 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000071 seconds
new results
WM_ACTIVATE 00000000 00000000, lastfocus 016100a8, current focus 016100a8

void
Site Admin
Posts: 3295
Joined: Fri Oct 16, 2009 11:31 pm

Re: Slow Download Shows A Size of 0

Postby void » Sat Dec 24, 2016 6:34 am

Thanks for the debug output.

Knowing that it wasn't right, suspected that either mencoder or MPlayer still had a handle on the file?


Sounds like MPlayer still had a handle to the file open.
When all handles are closed the USN journal record is committed, only then can Everything see the change in size.

but I didn't see any indication of a "change" in debug?


In the debug console? The message "total size 18086468, calculated in 0.000001 seconds" is only displayed when you perform a new search.
Everything will continue to update the total size in real-time, these changes are not shown in the debug log.
Since Everything has calculated the total size for all the results, only the size of file changes have to be added or subtracted from the total size.

therube
Posts: 1637
Joined: Thu Sep 03, 2009 6:48 pm

Re: Slow Download Shows A Size of 0

Postby therube » Thu Dec 29, 2016 3:20 pm

In the debug console?

Yes.
The message "total size 18086468, calculated in 0.000001 seconds" is only displayed when you perform a new search.
Everything will continue to update the total size in real-time, these changes are not shown in the debug log.

Ah, OK.


Return to “General”