Using readers and writers to extract and load data.
Recently active
Hello everyone. I know there are several questions posted about this same topic but I can't seem to get things working for my particular KML/XML description. I used this tutorial to get most of the way there: https://knowledge.safe.com/articles/19918/how-to-expose-feature-attributes-from-kml-tag.htmlI posted there in a comment but I figured I'd start a new question since this is more specific.I'm stuck on getting either the XQuery or the XML flattener to work. When I convert the description to XML, this is how it is formatted:<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"><html xmlns="http://www.w3.org/1999/xhtml"> <head> <title></title> </head><body> <b>V18279201018990_000.jpg</b><br /> <i>Latitude:</i> 37.424416°<br /> <i>Longitude:</i> -82.930091°<br /> <i&g
Hi everyone, I'm newbie here.I would like to writing CityGML also writing corresponding ADE Schema file.So, where can i start? Are ADE and CityGML files writing together? or can i write seperate and then communicate both files? Could you shine for this case i'll glad to you. Best Regard.
Hello everyone.I have run into a problem while validating dgn data. I need to check for elements that have specified graphic group, however I have run into a problem where cells seem to show igds_graphic_group = 0 even though in my editing software I see that it has graphic group set to non-zero value.I have tested this in FME 2016.0, 2017.0, 2017.1.Bellow is a snippet of one file I am working with (there are many more, over 8000) where I have encountered this problem. This is what I see in my editing software (MGEO, which is local version of microstation)No matter if I expand named cells, or keep just insert points of the cell, I always get igds_graphic_group = 0. Lines work just fine, there I get graphic group I see in my editing software. Any help is really welcome.Thanks,Radek
How to convert mySQl database to Mongodb?
Hi,I am using FME Desktop 2017.1 and trying to output a Microstation V8 DGN file with curves instead of line strings. I have exposed and set the igds_type attribute to 11 (ie: curve) but the output DGN now has no lines at all. Does anyone have any ideas?Thanks
Hello, do I have to use a dynamic reader when the name of an input shapefile changes but the schema does not? I use a workspace that reads a shape that gets updated every two months. I assumed that it suffices to link the new shape in the input parameters but no features are read due to the new filename. To prevent this I either create a new shp reader everytime or I create a workaround with a Creator/FeatureReader/AttributeExposer combination. Both solutions don't seem very elegant and I'm sure I'm doing this the wrong way. Is there a simpler way using a dynamic reader? Thank you for your help. This really irks me as I'm not a newcomer to FME.
I have LAS files that do not have any x,y,z fields to hold such values (seen in the image). Any way to fix it? I want to then export the x,y, z values to a csv file if possible or use it for further analysis.
Hi, Is there a page in the Knowledge base which defines what each Microstation DGN igds format attributes means? I have searched but cannot find anything...Thanks
It seems like the Reader in FME Workbench only supports tokens, but my ArcGIS Enterprise only supports OAuth connections, is there a Workaround?
Can somebody suggest me how can this be done in FME like what info is necessary in Input files and which transformer can be used ??
Hi I am trying to upload a workbench to FME Server but I keep getting the following error. Publish failed - FME Server encountered an error and reported the following message.TEMPLATE.bak is not a valid name. A resource named TEMPLATE.bak already exists.I have a template file named TEMPLATE.dwg that is in the workspace both in the writer and the dwg styler.Why am I getting this error?Is it possible to rectify? Thanks for any help.B
Here's a basic one. Have a Boolean field and need to evaluate if it is T or F using a Tester transformer.Have tried using "Field = F", "Field = False", "Field = 0" in the tester, but none of them seem to work.This should be straightforward but I can't find it anywhere in the documentation. Thanks in advance,
Hi, I have an .asc file that contains a maximum flood extent. All i want to do is convert the maximum output of the asc to a shapefile and a tab file. anybody go any ideas? had a read of alot of poasts, but cant find anything similar. Cheers.
I have an issue writing a particular feature class to a new PostGIS table. The exact same process works fine in our development environment, but not in the production. I have other features with exactly the same schema that work fine in production. I can't fathom how there would be an error connecting to the database when this isn't an issue during the same process but for another set of similar data. This is the error message I'm getting:Bulk copy failed on table '98ac753a-3b34-4aa4-8971-8cbe9c7b09c2.GDY_C_020M_DOWNLOAD_AREA' using delimiter ':'. Error was 'Error connecting to database'A fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for detailsFeatureWriter_24(WriterFactory): A fatal error has occurred. Check the logfile above for detailsSuccessfully closed POSTGIS database readerSuccessfully closed POSTGIS database readerStored 1 feature(s) to FME feature store file `/fme_temp/engin
First of all, I am new to this software. I would like to convert shapefile data to a csv file to be opened with excel. The data I am using is county data for the US and I would like to extract the lat and longs for all county borders. However, all I seem to be getting when I use the Quick Translator is the max and min lat long for each county. How get I get all the data I need from this file?
I have revised an old workbench to use the "new" db_operation variable to do add/modify/delete updates in one writer instead of setting three writers with separate modes. I wonder what was done? It looks like the updates are cached and applied in a single query. The time has dramatically reduced from 15 minutes down to 1 min 17 seconds! I am using a csv file to update a file geodatabase. The geodatabase is indexed on the key. The database is 7 GB and the main table contains 24.6 million records.I write the end of the log into an annotation to give me an easy persistent change over time:(The log shows the updates written/deleted but not the full table being updated)Features Written Summary=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-Title_Memorial 86576Title_memorial 586changeset 87162====================================================================Total Features Written 174324=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Hi All,I am trying to extract data out of Smallworld 5 using FME Desktop (smallworld edition). The idea eventually is that i can extract and full and deltas from the EO VMDS. The problem i am experiencing, is that it is crazy slow to extract - in fact, i can't extract at all.In the console window, i am seeing the following error: Join dd_join(unset) will be processed slowly for the following reason:Not 'fast' Could this be the reason of the slow extraction? if so, i have no idea what this means. Regards,Steve
I have a workspace that reads an Excel file pulling data from a specific worksheet and a specific cell-named-range. The read is implemented as a FeatureReader (Excel) but the problem I am experiencing is the same for both a FeatureReader (excel) and a Native Excel Reader,I am passing the name of the Excel file via a Published Parameter. I eventually want to process multiple Excel files that share a common data template. My issue is that when a NEW Excel file name is passed to the FeatureReader, the cell-named-range configuration is getting dropped and I am seeing the following warning in the logs:2019-02-04 10:08:43| 0.7| 0.0|WARN |Excel Reader: Found named range '_xlnm__FilterDatabase' on sheet '7 day speed and Vol Summary'. This is a Microsoft Excel internal name so FME will not show it as a sheet. If you wish to read this named range, please rename it My preference would be to have the Excel cell-named-range configurable as a reader parameters but currently you can only set i
It is known that FME can read from SharePoint. But my requirement is to read data from SharePoint portal (with workflows) and migrate to Documentum SharePoint is frontend for the customer storing the content and after migration Documetnum D2 will be used as frontend.I am looking at any FME based solution by way of APIs, customization etc. TxSRG
We want to send and receive email with FME Server, and our IT say that we're moving away from smtp / imap so, medium term, we can't use either, only Exchange Web Services (because our corp mail implementation is going cloudy).Does FME Server understand EWS?
Hi, A simple question -> I want to write "" value in a field in a csv file using csv writer.When this csv file is opened in notepad, the value should look at "" and not as """""".E.g. Note the third column, that is how it should be visible.ID,Name,Comment12,Vijay,""13,Sambhe,"" Its odd but that is the requirement. I can add a workspacerunner, read csv as texfile and replace """""" as "" and write to a textfile but I want this to be done in a single workspace. Thanks,Vijay
Hi, I have building floor plan with floor number (which is like G, M1, M2, M3, F1, ...F19 etc.) and I have height of each floor (like 3.4, 4, 4.5 etc.). We want to show the elevated floors in GIS with as per the exact height from ground (which is height of G+M1+M2+M3+F1+F2 and so on). I have attached a sample file. We have more 10000 buildings and each building has multiple floor so manual calculation of floor elevation is tedious work.
I am having issues using the ArcGIS Portal Feature Service reader. The reader accepts the host name and my username and password and it is able to successfully load all of the feature services. After I select a feature service, I click the ellipses button next to "Layer List" and it gives me the following error: Has anyone else experienced this error message?
Hello everybody. I added texture images to building walls in sketchup, and then I tried to transform .skp file to CityGML using FME. Transformation went successful, HOWEVER, FME doesn't save pictures the way I set them to fit the wall, it just saves the original picture as if I didn't do all the work with fitting and rotating the picture. Can anybody help me? Thank you!
Hello,Is there a way to force fme to delete all the temporary/working files at the end of each translation?I'm working with huge las files and it is taking a lot of memory so that I have to manually erase such files before doing the next translation. Thanks
