Skip to main content
Open

Give me an error instead of half writing tables!

Related products:FME Form

ecx
Supporter
  • Supporter

Hello,

I came across this warning:


“ 2024-10-08 15:14:19|  14.7|  0.0|WARN  |Microsoft SQL Server Non-Spatial Writer: Failed to parse `Date' from attribute value ` 19810101' for column `InstallDate'
2024-10-08 15:14:19|  14.7|  0.0|WARN  |Microsoft SQL Server Non-Spatial Writer: Failed to parse ' 19810101' as a datetime value. For FME datetime syntax, please see http://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_Workbench/! “

 

As you can see, FME is trying to write to a SQL database, but is failing due to syntax error. 

This results in all of the items that have this syntax error NOT BEING WRITTEN to the database, and those which do match the syntax being written. In my specific case this resulted in 25 features out of 20,000 not being written, as this was a warning rather than an error this was missed for several months, causing quite a few issues. 

Can we get an option to cancel transactions or throw an actual error in the case data is not being written in its full extent?


Thanks

6 replies

redgeographics
Celebrity
Forum|alt.badge.img+50

I’ve been hit by this one too (combined with an attribute name that seemed to imply it was a numerical field… “numberoftracks”…. turned out the possible values were “one”, “two” and “lots”)


s.jager
Influencer
Forum|alt.badge.img+16
  • Influencer
  • October 8, 2024

Yup. I‘ve been bitten by this one too. In general you’re never 100% sure if stuff was (partly) written or not, when you get these kinds of warnings. So then the state of your data becomes completely unclear, and it takes time to check the integrity afterwards…

@redgeographics : How about “diameter” on a pipeline? You’d think that be a numerical value. Some of the actual values I found: “2.5 inch”, “2,5 inch”, “20 centimeter”, “45”, “twee decimeter”….. 

But I must admit that “lots” made me laugh 😄


redgeographics
Celebrity
Forum|alt.badge.img+50
s.jager wrote:

 

@redgeographics : How about “diameter” on a pipeline? You’d think that be a numerical value. Some of the actual values I found: “2.5 inch”, “2,5 inch”, “20 centimeter”, “45”, “twee decimeter”….. 

But I must admit that “lots” made me laugh 😄

Oooof, that is just nasty…

I must admit I did exaggerate for comedy effect, the actual values were “Enkelspoor”, “Dubbelspoor” and “Meervoudig”. End result was that my database with Top10NL data had no railways...


s.jager
Influencer
Forum|alt.badge.img+16
  • Influencer
  • October 8, 2024

Try to extrude a pipeline into a 3D object by a value of “1.2 feet”….

 

“End result was that my database with Top10NL data had no railways”

And that is what gets me. If you do not carefully dig through the logfile, you’ll miss the fact that some of the data wasn’t actually written, when the translation log says that it was succesful… Been working with FME for a good 12 years or so now, and this still trips me up now and then...


nielsgerrits
VIP
Forum|alt.badge.img+54

I learned to be triggered by differences in featurecounts because of this.


LizAtSafe
Safer
Forum|alt.badge.img+15
  • Safer
  • January 21, 2025
NewOpen

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings