DeepZoomTools.dll -> Exception from HRESULT: 0x88982F05

I'm getting this error when processing some jpeg files. Most of the files work, but some don't.

The image data generated an overflow during processing.
Exception from HRESULT: 0x88982F05

My code is pretty basic (I even tried commenting the ImageQuality and MaxLevel setting):

Dim z As New Microsoft.DeepZoomTools.ImageCreator()
z.ImageQuality = 0.95
z.MaxLevel = 12
z.Create(ZoomImage.FullName, XmlFile)

I believe it has something to do with the metadata in the image.
When I use photoshop to copy the content om the image in a new canvas and process that new file, it works perfectly.