Using readers and writers to extract and load data.
Recently active
Is it possible to create an FME workflow that will periodically check a hosted feature service for updates or edits, and then generate a report of those edits made and by who? If someone has done something similar before please let me know.
Has anyone experienced a similar warning/error in FME when using the SQL Server JDBC writer, writing out to a binarygeometry data type?If so am I ok to ignore, it only came up as a warning not an error.Many ThanksExample below:MS SQL Server (JDBC) Writer: Error writing feature. Error: serializeGeometry not implemented+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Feature Type: `dbo.V_PLAYFINDER_PXS_LOCATION'Attribute(encoded: UTF-8) : `LONG_ABBREVIATION' has value `CAM'Attribute(encoded: UTF-8) : `MID_X' has value `-60.59640903'Attribute(encoded: UTF-8) : `MID_Y' has value `13.31999124'Attribute(32 bit integer) : `OBJECTID' has value `106'Attribute(encoded: fme-binary): `POLYLINE' binary value as HEX `010200000002000000CC323298041250C0C03E48C3E7602B40C03AC512A5744CC060EE7D05C4E62940'Attribute(encoded: UTF-8) : `PRODUCT' has value `PC_G2020X'Attribute(32 bit integer) : `PRODUCT_ID' has value `1894'Attribute(encoded: UTF-8) : `PROD
Hi FMEer's!Can someone kindly point me to tutorials/webinars of where the workbench is writing particularly large amounts of data to spatial and non-spatial databases? I have many models that write to Oracle databases, SQL Server, ArcSDE etc. However, I find that the moment we start writing 100's of thousands of records it is quite slow. It's generally quicker to import a table into one of the databases and do the truncate and load through a database management software. Some of the methods I use in FME are: - Change detection and use FME_DB_OPERATION = Insert or Delete (Not sure really how to use the Update) - Truncate table and insert (Use this when the table is massive and change detection is just not feasible)- Write to ESRI file geodatabase first and then copy to ArcSDEAny help is much appreciated, I just want to make my models more efficient! Kind regards,Kam
I have an FMW script that includes an AttributeCreator transformer. I want to include 500 additional attribute creator transformers. It would be tedious to create them in the workbench. Instead, I would like to create them with a little Python script and then splice the generated code into the FMW script. Is there any documentation on how to manipulate the FMW text file?
Does anyone know if FME has compatibility with MongoDB's GridFS to store documents that are larger than 16MB? I've written an embedded JSON but the average document size is 49MB. Will I need to load it into mongo outside of FME or is there capability for this currently?
Hey all,I'm a new user of FME. And we are using FME (or trying to) to convert bathymtrie data (in PTS format) to geotiffs. We used to do it in C3D but after seeing some vids of fme i think it will be allot faster and easier using fme.So i googled it and tried some things but i keep ending up with the same error log ( in a picture below.). After some more search work i got the advice to first convert the PTS format to a LAS format. But still i'm givin the same error. I'm guessing there is something wrong with my parameters? Thanks for the help. Grts,Koen
This is what I haveThis is what I needAs you can see I need to transpose the ID but retaining the rest. I am unsure how to phrase the question so I guess the images shows my problem better than my phrasing!My table has more than thousand records and I tried many combinations of sorter, counter, attributeexploader and so on until the point that I am very confused as how to even approach this in FME. Any suggestions are appreciated! And yes, I'm very new to FME. Output should be a csv but that is less of a concern right now.
Hello. I have to read a number of xml files that are "version 3", modify the contents and write them out as "version 4". The changes include renamed xml tags, some reorganization, addition of some new tags etc. When I read in an xml it deserializes the contents into attributes (which is really great!). I'd like to make my modifications to these attributes (and their values), then write out the result. Instead it writes back out the original file contents which it has saved in the attribute xml_fragment. Is there a way I can tell the writer to output the contents of the attributes and not the xml_fragment?
Is there any possibility to create a fmw file on the fly in the command line itself,with coordinate system and file types source and destination as arguments.
I'm receiving binary pdf files from a web service. I've successfully decoded and written them to my file system. However, I would like to combine certain files with a similar attribute into one pdf of multiple pages. Any ideas how I can do this in fme?
I need to read a filename and path from a database, then use these values to open the file on the File System. Unfortunately the Reader standard do not take filemane from previous features. How may i handle that ? Thanks
This is a bit of a review question... I try to convert GML and I wonder if I'm on the right track. Workbench does the job but I'm not sure this is the way to do it.For example, the featuretype "Waterleiding" has a relation to the featuretype "UtilityLink", which I like to restore. My goal is to add the attributes from Waterleiding to the line UtilityLink. In the end, I want to import the GML using FME server in our WebGIS application to visualise the contents.Waterleiding:inspireId.Identifier.localId = KN1100.2009051707431500023782inspireId.Identifier.namespace = nl.imkllink = nl.imkl-KN1100.2009051707431500023782.ulinkUtilityLink:inspireId.Identifier.localId = KN1100.2009051707431500023782.ulinkMy current solution is to create an attribute LinkId in the Waterleiding set from the link attribute (AttributeCreator_5) and replace string the namespace attribute (StringReplacer_2) to convert nl.imkl-KN1100.2009051707431500023782.ulink to KN1100.200905170743150002
Hi all,Does anyone have a tip on how to fill the walls of a 3D object? The idea is to create a mesh from a DEM using SurfaceModeller and then extend the object to 0 elevation or to the lowest point of the input DEM so that it looks it was all cut from the Earth surface by a sharp cookie cutter. The closest I got was to input the BB of the raster as Breakline input into the SurfaceModeller but it won't result into straight lines as the SurfaceModeller seems to cut off a little from the edges of the DEM.Thanks!Jan
Hi, I have a DWG group file with labeling texts converted from esri Annotation group layers. When I open the DWG file in ArcMap, I can see featuerID(not system ID, but ties to original feature that was labeled), horizontalAlignment, verticalAlignment fields. But when I bring it to FME, I can not expose these attributes. I have tried different things such as, change parameters to attributeschema etc., but I still can not see these attributes. Is there anyway I can do this?Thanks!
Hello,I have an IFC file that is in Snakegrid local coordinate system, however I do not have access on how this IFC was created in the first place. I also have a .dat file that specifies the Snakegrid parameters for the area of interest. The workflow I have been using is suitable to change the coordinate systems between dgn files.I would like to ask if it is feasible to convert an IFC file that is in SnakeGrid to OSGB (EPSG: 27700)?Thank you for your time.Kind regards,George
Hey there,I need to convert a cityGML file to Geodatabase or just in a file to get the cityGML in Arcgis Pro.I used a Workflow right from the internet. But the transformation failed.I tried the convertions with this workflow https://github.com/Esri/3d-cities-template/tree/master/Workflows/3DCityMaintenance/CityGML%20ToolsYours sincerleyTobi
Hi everyoneI have a question regarding the SDE Writer (Geodatabase SDE) in FME (FME 2017). There are some issues regarding geometry problems, e.g. self-intersecting polygons cannot be inserted into an Oracle Database with SDE (ERROR |An error occurred while attempting to insert a row into the table 'XXX' using a cursor. The error number from ArcObjects is: '-2147215968'. The error message from ArcObjects is: {Linestring or poly boundary is self-intersecting}).How can this problem be addressed? (Using PostGIS, these geometries can be inserted normally) I tested the GeometryValidator transformer, which seems not to be the right way though: sometimes the self-intersecting geometries are detected and sometimes they’re not detected (!). After repairing these geometries using the GeometryValidator, there is another error while inserting the data into the DB (ERROR |An error occurred while attempting to insert a row into the table 'XXX' using a cursor. The error number
I have csv data in a single attribute like this (field names are first line). Grower,Date,SampleNum,P,K,C1000,05/01/2018,350,275,1500how can I parse this into feature(s) with the correct collums using fme?
I have a model which failes without giving any specific feedback in the log, just: "Translation FAILED". After enabling Log Debug one line is added in red: "(stfgeometryproperty.cpp:42) STFGeometryProperty::getAsSimpleAttribute".Is this a known error? Where do I have to start looking? It is a large model with a lot of input, debugging the model piece by piece will take some time.
How to convert wms to kml in fme.I tried converted but the file got converted has no geometry and schema is defined for the converted file.Why is this happening what error am i doing.Or how to convert wms to shape file.
I've a large installed base of Revit with versions from 2016 to 2018 and one of the worst problems we are dealing with is the incompatibility between these versions. I would like to know if FME Destkop can act as an intermediary in order to read from one version and write to a different one. Maybe the plugin for Revit and the rvz format could be the solution, but I'm not sure about this (I didn't have explored this). Thanks a lot!
Has anybody ever tried to create an external Style.kml file that is being referenced by other KML/KMZ files? I have seen several blogs where the KML StyleMap is defined by creating a Style feature, and I've got that working fine. But I've got 500+ KML files (all regionalised etc.), and the result is that each of them has the same StyleMap definitions in the top of the KML. I would like to define all my Style definitions in a separate KML/KMZ file, and each KML file to reference just this file.The Google KML documentation shows this is possible, and all you need is a line like this:<styleUrl>style.kml#counties</styleUrl> But how to get this in FME? I have been playing around with the kml_style_url_* and kml_target_style_* attributes, but have been unable to crack it, and there doesn't seem to be any documentation on all these kml_* attributes.
Hello All,I am new to FME. My actual intention is to build a geopdf from 2 or more vector sources. And I would like to overlay some point layer which should hide in the default view but should be revealed when I zoom in the geopdf. Can you please let me know if this is possible and how.Thanks in advance,Praveen Kumar Bandi
I'm using FME Workbench 2018.1 FME(R) 2018.1.0.2 (20180903 - Build 18547 - WIN64)Sometimes the directory and file pathnames reader does not stop once it has read all files on my external hard drive. It reads the same files multiple times. The only way I've found to fix this is to delete the reader and recreate it, however even then it's pretty inconsistent with whether it stops or not after reading all the files.I have tried setting max number of features to read to 5 in order to test if it stops, and it doesn't stop after 5 features.Has anyone else had this happen? Is there a solution?After a little further testing, it appears that I start running into problems when I use * as a path filter.