Log file errors concerning sony's raw (*.arw) files

[reader]

Not sure if my old sig will show on these messages so here is the main points:
Running Im5 on Win7 64 bit.  on a Sager NP8760 laptop with core i7, quad core
with 8gb of ram installed.

I'm creating a db of 1640 files.  The vast majority will be 6000x4000 and probably 75% are sony raw format *.arw.  There are a few small videos scattered in there maybe as many as 2-3 but probably half that.  There are 55 photoshop images with *.psd extensions... most will be quite large, most would be over 60mb and under 70mb, a few much smaller.

1266 *.arw files all at 24mb... the rest mostly *.jpg. All and all some 35+ GB of data.

I'm a long ways from having enough expertise to even guess what these errors mean.  I don't know if this represents
a bug so have not prepared it as a bug report... just hoping to get some idea of what it means.

Sorry about the long lines.  It appears to report an error but then states that no error was reported... strange.

I've put a few of the lines that puzzled me below and have attached the full log.

07.02 18:02:30+335902 [0860] 02  I>  PTPIMM: Using WIC codecs for these formats:
07.02 18:02:30+   62 [0860] 01  W>  EUQH::Load(1) failed for \\m2\m2-d\imatch5_t01\2013\130606\mts\00000.mts (8/'Not implemented') with 0 x 0  'IMEngineUpdateQueue.cpp(473)'
07.02 18:02:30+   31 [0860] 01  W>  EUQH::Load(2) failed for \\m2\m2-d\imatch5_t01\2013\130606\mts\00000.mts (8/'Not implemented') with 0 x 0  'IMEngineUpdateQueue.cpp(486)'
07.02 18:03:30+59639 [0860] 01  W>  PTPIP::Load failed with No error reported.  'PTPIP.cpp(2774)'
07.02 18:03:30+    0 [0860] 01  W>  Error loading \\m2\m2-d\imatch5_t01\2013\130607\dsc00452.arw with error 1 'No error reported.'  'PTPIImage.cpp(287)'
07.02 18:03:30+    0 [0860] 01  W>  EUQH::Load(1) failed for \\m2\m2-d\imatch5_t01\2013\130607\dsc00452.arw (8/'No error reported.') with 0 x 0  'IMEngineUpdateQueue.cpp(473)'
07.02 18:04:50+79889 [1098] 01  W>  PTPIP::Load failed with No error reported.  'PTPIP.cpp(2774)'
07.02 18:04:50+    0 [1098] 01  W>  Error loading \\m2\m2-d\imatch5_t01\2013\130612_examples_18135_55300\dsc00569.arw with error 1 'No error reported.'  'PTPIImage.cpp(287)'
07.02 18:04:50+    0 [1098] 01  W>  EUQH::Load(1) failed for \\m2\m2-d\imatch5_t01\2013\130612_examples_18135_55300\dsc00569.arw (8/'No error reported.') with 0 x 0  'IMEngineUpdateQueue.cpp(473)'
07.02 18:06:06+76331 [0860] 01  W>  EUQH::Load(1) failed for \\m2\m2-d\imatch5_t01\2013\130622\IDCLabelInfo.xml (8/'Not implemented') with 0 x 0  'IMEngineUpdateQueue.cpp(473)'
07.02 18:06:06+   47 [0860] 01  W>  EUQH::Load(2) failed for \\m2\m2-d\imatch5_t01\2013\130622\IDCLabelInfo.xml (8/'Not implemented') with 0 x 0  'IMEngineUpdateQueue.cpp(486)'


[attachment deleted by admin]

[Mario]

Do you have a WIC codec installed which supports your ARW files?

Select one of the ARW files in the file window.
Go to Help menu > Support > WIC Diagnostics
Attach the output of this command to your reply. This will show if a WIC codec is installed and if it handles this ARW variant.

For general info about WIC, see my blog article WIC Support and Codec Availability

[reader]

Do you have a WIC codec installed which supports your ARW files?

I don't really know but I've had no problems viewing and so forth in Im3.6 or any adobe tools. Also including
Fast picture viewer

Select one of the ARW files in the file window.
Go to Help menu > Support > WIC Diagnostics
Attach the output of this command to your reply. This will show if a WIC codec is installed and if it handles this ARW variant.

For general info about WIC, see my blog article WIC Support and Codec Availability

Are the instructions at your link above for 3.6?   I ask because under "Enabling WIC Support in IMatch" the first instruction is to go to "Options > Preferences > File Format Preferences" and I don't see an 'Options' item on any menus. Or a 'File Format Preferences' in the Preferences available under Edit > preferences on IM5

OK log file attached

[attachment deleted by admin]

[reader]

Do you have a WIC codec installed which supports your ARW files?

I don't really know but I've had no problems viewing and so forth in Im3.6 or any adobe tools. Also including
Fast picture viewer

Just a PS to the last msg... I can view the *.arw files as thumbnails in windows explorer if that tells you anything.

[claudermilk]

The FPV WIC codec that IMatch would use is separate from the main program. I can say that IMatch will import ARW files--I have a few sample images (I think from Sony's site somewhere) that I use in the test database--and I'm sure Mario has many more than I.
Mario's instruction would be for IM5. I would suspect that the WIC codec is the likely issue.

[reader]

The FPV WIC codec that IMatch would use is separate from the main program. I can say that IMatch will import ARW files--I have a few sample images (I think from Sony's site somewhere) that I use in the test database--and I'm sure Mario has many more than I.
Mario's instruction would be for IM5. I would suspect that the WIC codec is the likely issue.

In that case where are 'Options > preferences' found on IM5... you'll find that reference under:
Enabling WIC Support in IMatch on the link Mario cited.

Ok, so I guess you are suggesting that I should download and install the WIC codecs from the url...
Some where it was mentioned that it mattered if you had a 64 bit mach, that you install 64 bit WIC codec, but on the site there is no mention of 32 or 64 bit, just a download for win7

Oh PS - so what problem do those log lines indicate?  I'm actually not seeing anything obvious when fiddling with over a thousand *arw files in my test db, so would like to know what those lines mean.

[Mario]

IMatch uses the FastPicture Viewer codecs on your machine and these codecs should be able to handle your ARW files just fine.

Still, the codecs return an error message to IMatch, e.g. for

\\m2\m2-d\imatch5_t01\2013\130607\dsc00452.arw

What is the effect you are actually seeing? Do these files show no thumbnails? Do they show up in the Quick View Panel or the Viewer?

[reader]

IMatch uses the FastPicture Viewer codecs on your machine and these codecs should be able to handle your ARW files just fine.

Still, the codecs return an error message to IMatch, e.g. for

\\m2\m2-d\imatch5_t01\2013\130607\dsc00452.arw

What is the effect you are actually seeing? Do these files show no thumbnails? Do they show up in the Quick View Panel or the Viewer?

Well, as mentioned in a previous part of this thread, I'm not actually seeing anything noticeable.  Even going direct to the file cited above... I see a thumbnail it appears normal.. but I'm so new to im5, I'm not sure I'd recognize it if it were abnormal.
But it appears normal to me.

Do those log messages not tell you what the problem is?
As I mentioned in the initial report, I did not have DEBUG LOGGING turned on when those messages occurred  but did turn it on after posting the message.  That was yesterday the 2nd I think.   Today's log (July 3) shows no such errors and one of the things I did today was run a full rescan with 'force update' turned on (I had changed the thumbnail size).

So, the most recent log (with DEBUG LOGGING enabled) shows no errors of any kind .. or at least the term [Ee]rror doesn't occur in it.

[reader]

IMatch uses the FastPicture Viewer codecs on your machine and these codecs should be able to handle your ARW files just fine.

Still, the codecs return an error message to IMatch, e.g. for

\\m2\m2-d\imatch5_t01\2013\130607\dsc00452.arw

What is the effect you are actually seeing? Do these files show no thumbnails? Do they show up in the Quick View Panel or the Viewer?

Well, as mentioned in a previous part of this thread, I'm not actually seeing anything noticeable.  Even going direct to the file cited above... I see a thumbnail it appears normal.. but I'm so new to im5, I'm not sure I'd recognize it if it were abnormal.
But it appears normal to me.

[...]

Whoa wait a minute... I do see a problem.  In  filename cited above(\\m2\m2-d\imatch5_t01\2013\130607\dsc00452.arw) listed in the log, when I click on the 'I' information icon on the thumb it shows the size as 160x120 At 23.6MB... which is pretty far fetched... And then when sent to viewer it remains the tiny 160x120. Whereas viewed in explorer it is 6000x4000 so I guess there is quite a discrepancy there.

[Ferdinand]

I've got a lot of Sony ARW files from a couple of cameras and I use FPV codecs and I don't have this problem.

However my brother had symptoms like yours (only small thumb-sized images), although he wasn't using FPV codecs at the time.  We tried installing the latest Sony codecs but the MS ones seemed to dominate, even though they didn't support his camera at the time.  What we did to his machine is uninstall the Windows and Sony codecs and then install the latest FPV ones and force rescan the affected images and all was well.  This was in IMatch 3.6 but I suspect that the solution would be the same in IMatch 5.

[Mario]

160x120 is the size of the thumbnail embedded in the file. This is usually a clear indication that the WIC codec could neither extract an embedded preview nor the original RAW data. At least for the file used for the WIC Diagnostics  the codec did extract a valid file. Can you run a WIC Diagnostics on the file in question? We should see that the codec cannot extract a valid image.

If you have another file with this effect, you can try to force a rescan: Context menu of the file in the File Window, choose Rescan from the menu while holding down <Ctrl>. Then choose Force Update. Maybe the WIC codec hat a temporary problem or was under stress and now it works.

[reader]

160x120 is the size of the thumbnail embedded in the file. This is usually a clear indication that the WIC codec could neither extract an embedded preview nor the original RAW data. At least for the file used for the WIC Diagnostics  the codec did extract a valid file. Can you run a WIC Diagnostics on the file in question? We should see that the codec cannot extract a valid image.

WIC DIA before rescan:
Testing file '\\m2\m2-d\imatch5_t01\2013\130607\dsc00452.arw'
   Thumbnail: Codec 'Sony Raw Decoder (FastPictureViewer Codec Pack)'
      () 160x104 pixel in 718 ms.
   Preview: Codec 'Sony Raw Decoder (FastPictureViewer Codec Pack)'
      (GetPreview failed (88982F81 Unknown error 0x88982F81).) 0x0 pixel in 0 ms.
   Full resolution: Codec 'Sony Raw Decoder (FastPictureViewer Codec Pack)'
      () 1616x1080 pixel in 16 ms.

If you have another file with this effect, you can try to force a rescan: Context menu of the file in the File Window, choose Rescan from the menu while holding down <Ctrl>. Then choose Force Update. Maybe the WIC codec hat a temporary problem or was under stress and now it works.

The rescan seemed to go thru OK, and the thumb came up to the size of all the other thumbs

However I ran the WIC DIA on it after the rescan and it  appears to have stayed the same:
Testing file '\\m2\m2-d\imatch5_t01\2013\130607\dsc00452.arw'
   Thumbnail: Codec 'Sony Raw Decoder (FastPictureViewer Codec Pack)'
      () 160x104 pixel in 718 ms.
   Preview: Codec 'Sony Raw Decoder (FastPictureViewer Codec Pack)'
      (GetPreview failed (88982F81 Unknown error 0x88982F81).) 0x0 pixel in 0 ms.
   Full resolution: Codec 'Sony Raw Decoder (FastPictureViewer Codec Pack)'
      () 1616x1080 pixel in 16 ms.

And just so its clear to you.  *.arw files before and after this one appear normal Although there are a few more that appear as much smaller.  Both the apparently normal ones and the smaller ones show the same error when WIC DIAG is run on them.

Egad, in fact a random sampling elsewhere in the DB... all show the same WIC DIAG error.  Here is one from a *.jpg

Testing file '\\m2\m2-d\imatch5_t01\2013\130630\_01045.jpg'
   Thumbnail: Codec 'JPEG Rotator (FastPictureViewer Codec Pack)'
      (GetThumbnail failed (88982F44 Unknown error 0x88982F44).) 0x0 pixel in 0 ms.
   Preview: Codec 'JPEG Rotator (FastPictureViewer Codec Pack)'
      (GetPreview failed (88982F81 Unknown error 0x88982F81).) 0x0 pixel in 0 ms.
   Full resolution: Codec 'JPEG Rotator (FastPictureViewer Codec Pack)'
      () 6000x4000 pixel in 31 ms.

[reader]

I've got a lot of Sony ARW files from a couple of cameras and I use FPV codecs and I don't have this problem.

[...] snip

Would you mind running a WIC DIAG on a random *.arw file and post the last paragraph for us to see?
(Select in Files window, then - Help>support>WIC DIAG)

[Mario]

Full resolution: Codec 'Sony Raw Decoder (FastPictureViewer Codec Pack)'
      () 1616x1080 pixel in 16 ms.

That's the important bit. The WIC coded did deliver a 1616 pixel image for that file. IMatch will use this to produce the thumbnail and the cache image so the file should show up properly in IMatch (up to the delivered 1612 pixel). Which is sufficient for the thumbnail and an almost screen-size preview. If you only get a small thumbnail-size images, something else is wrong or the codec did deliver other status codes.

Can you please send me one of the problem files to my support address (see below in my sig).
Please include a link to this thread in your email so I can relate the file (I get many files per day).

[Ferdinand]

Would you mind running a WIC DIAG on a random *.arw file and post the last paragraph for us to see?
(Select in Files window, then - Help>support>WIC DIAG)

Testing file 'G:\My Photos\2013\04_21\DSC4491.arw'
    Thumbnail: Codec 'Sony Raw Decoder (FastPictureViewer Codec Pack)'
        (GetThumbnail failed (88982F44 Unknown error 0x88982F44).) 0x0 pixel in 0 ms.
    Preview: Codec 'Sony Raw Decoder (FastPictureViewer Codec Pack)'
        (GetPreview failed (88982F81 Unknown error 0x88982F81).) 0x0 pixel in 0 ms.
    Full resolution: Codec 'Sony Raw Decoder (FastPictureViewer Codec Pack)'
        () 1616x1080 pixel in 0 ms.

[reader]

Would you mind running a WIC DIAG on a random *.arw file and post the last paragraph for us to see?
(Select in Files window, then - Help>support>WIC DIAG)

Testing file 'G:\My Photos\2013\04_21\DSC4491.arw'
    Thumbnail: Codec 'Sony Raw Decoder (FastPictureViewer Codec Pack)'
        (GetThumbnail failed (88982F44 Unknown error 0x88982F44).) 0x0 pixel in 0 ms.
    Preview: Codec 'Sony Raw Decoder (FastPictureViewer Codec Pack)'
        (GetPreview failed (88982F81 Unknown error 0x88982F81).) 0x0 pixel in 0 ms.
    Full resolution: Codec 'Sony Raw Decoder (FastPictureViewer Codec Pack)'
        () 1616x1080 pixel in 0 ms.

Huh... you get the error message too, but have no problems... I have many *.arw that processed problem free, and only 3-4 that didn't... but the WIC DIA after rescan looks just like yours.  I guess this error message is not the cause of my problem

[reader]

[...]

Can you please send me one of the problem files to my support address (see below in my sig).
Please include a link to this thread in your email so I can relate the file (I get many files per day).

At high risk of sounding like a total dunce here... I guess you mean the email support 
Its not actually in your sig ... I only see www type addresses there. So sending to the email above.

[Mario]

I don't publish my email in my signature to protect it from web spiders and SPAM harvesters which pick up emails from boards like this.
Just click on the support link to get directed to my official contact page at www.photools.com - there you'll find my email under 'Direct Email Contact To The Developer' -  which means me 

[reader]

I don't publish my email in my signature to protect it from web spiders and SPAM harvesters which pick up emails from boards like this.
Just click on the support link to get directed to my official contact page at www.photools.com - there you'll find my email under 'Direct Email Contact To The Developer' -  which means me 

Gack.. sorry, yes that makes sense... anyway file sent with link to this thread.

[Mario]

I tested the file on my system with the FastPictureViewer codecs version 3.5.0.78 installed.
The file is loaded without problems at 1616x1080 pixel.