Using readers and writers to extract and load data.
Recently active
Dear fme users, I'm here to ask your most valuable help. I have hundreds of .dwg files in a directory and I need to process all of them adding 6 attributes to each drawing, the values of these attributes must be taken from the file name. I managed to build a workflow that assigns the attribute values to 6 columns but I can't figure out how to convert this values as recognized attributes by the output file produced with a standard writer.Small example:Input file:name: ATTRIBUTE1_ATTRIBUTE2.dwgno attributesOutput file:same nametwo attributes: number one - ATTRIBUTE1 number two - ATTRIBUTE2Thanks a lot for your help.
HiI am trying to write to sql server rds on amazon using the jdbc writer, it is really slow. What options do I have to make this any faster. Currently it is inserting 1000 records to a 4 column (all strings) table @20s intervals. using sql server import export wizard is about 50x faster.Thank you
I am using the ArcGIS Online geocoding service inside the Geocoder transformer. The transformer successfully returns results but the "score" attribute does not appear in the Inspector. The "score" attribute comes with the JSON results from the ArcGIS Rest API and I need the values to filter out low scoring geocoding results. Is there a way to expose this? I assume FME is filtering it out along with many other attributes in the resulting JSON. I am using FME 2018.1.1.2 (build 18586 - Win32).
Hey everyone, I am trying to create a report that contains a list of errors. I would like to add checkboxes next to each error as an easy way to keep up to date on what errors have been addressed. Is there a way to do this? I have looked into the Custom HTML, but I'm a little confused on how the ReportGenerator adds the attribute to the HTML statements.Any help would be greatly appreciated. Thanks!
Hi there, I'm currently working on my master thesis which is about urban building energy modelling, I am using the university campus as a case study and just wondering whether it's possible to convert the model from cityengine to citygml format as i don't have technical background. Or, is it better to model simple geometry on Revit and import an IFC file into FME then convert it into citygml format. Many thanks
Trying to query tables from a GeoPackage file with st_intersections() function availabe for spatialite. When I run the SqlExecutor , I have an error logged :GEOPACKAGE reader: In ExecuteSQL(): sqlite3_prepare_v2(select grid_id,geom from grid where st_intersects((Select geom from var_fuelt17),grid.geom) group by grid_id): no such function: st_intersectsTried to use Spatialite Database format pointing to geopackage file but run into issue.All spatial functions are working in QGIS or using spatialite 4.3 command line tools.Any ways to make it work ?
Hi,I've received an FME workbench from a colleague which uses an SQLCreator to read an Oracle Spatial database. I wanted to recreate the steps by reading from the database using the Oracle Spatial Object Reader, however when inspecting the same tables and features there seems to be no geometry related to (some of the) objects.The weird thing is one table does show geometry, and others don't. I have also tried reading the database using an SQLExecutor as well as a FeatureReader and these two also don't read any geometry.Does anyone know what might cause this problem/difference between transformers and readers, and knows how to solve it?Thanks in advance.
When using the GoogleBigQueryConnector transformer, I can see my geometry field 'geo' that I created. When I use the Google BigQuery reader, the field 'geo' shows up, but using an inspector connected to the reader, all records show <missing> in the 'geo' field.Is this a known issue? If so, how can I get around this? I'm hoping to get geometry features from the reader. Thank you in advance!
I need to put on Roofs on my 3D building models (Polygons with z z height information) .. is there a way to do it in FME? Maybe somehow by calculating the middle line of the polygons?
Hallo everybody,I'm trying to export an valid CityGML building into a GeoPackage. In the result, I get a bunch of line segments representing the Groundsurfaces and Roofsurfaces with hight. All surfaces / polygones are lost.I tryed to filter the geometry, so only surfaces go to the writer. Same result.Does anyone have an idea how to export 3D buildings into Geopackage?
I need to convert Segy to Tiff. Does anyone know how to do this with FME?
In the following snippet (which has been reduced in length from the above file) are the results from a web api. I need to create a point for every coordinate pair and add the relevant attribute data to the point table. I am having problems due to the ID of each feature e.g. "535412" which envelopes the other attributes. How can I manipulate the json file to be able to write a shapefile with the attributes as fields?{ "Results": [ "535412": { "Standortbescheinigungsnummer": "021296", "PostalischeAdresse": "Gstraße 8, 35560 Musterort", "Standortbescheinigungsdokumente": { "AktuellsteStandortbescheinigungsdokumente": { "STOB": "15ba5116-be92-4c61-8a72-22d605b70f", "TD": "e3452231-0f4f-4d10-8b38-40386acd1a" } }, "KOORD_NORD_DEZ": 53.117221, "KOORD_OST_DEZ": 9.791388 }, "545123"
Hello.This is a two-parter question, I hope that is ok. This is a bit of a long post, but both questions are related. And I'll start by saying I don't know much about AutoCAD but..Question #1: I have a question about the Autodesk AutoCAD DWG/DXF reader at FME 2012 vs FME 2019. I know this is a very big leap in terms of software versions, but we're doing an upgrade at the moment so I am going through updating scripts. Where I can, I've been updating transformers to the newest versions. What I've noticed, is that the same dataset read by FME 2012 identifies fme_type / autocad_entity areas and ellipses differently than FME 2019. For example (using the exact same dataset):FME 2012 reads this feature as autocad_entity = autocad_polygon / fme_type = fme_area:But FME 2019 reads the exact same feature as autocad_entity = autocad_ellipse / fme_type = fme_ellipse:I guess I'm just trying to confirm whether this makes sense - I'm assuming geometry handling has been impr
See https://knowledge.safe.com/questions/38060/sde-connection-files-and-fme-server.htmlI might be OK with read only ArcSDE connection files being in a shared area, but ones with write access need to be restricted. So new system share may be the answer.If I have a Workspace with a read only ArcSDE connection and a write ArcSDE connection, I can't seem to choose separate locations on server for each one - they both have to go in the same place (that's using FME 2018). So it looks like I will have to create a Workspace with the read only connection file and publish that to upload it to the shared area, then use that in Workspace with the write connection file stored locally.Is there no way to load ArcSDE connection files into the shared area outside of Workspace publishing? Can you just copy the files to the appropriate folder on the FME Server server?
Hello, I want to get the value from <a> tag in the following HTML table, someone has an idea how can I get it? I tested HTML extractor, FeatureReader, but don't return me "Website". Thks<table id="myTable"> <tr> <td>hello</td> <td>it's me!</td> </tr> <tr> <td>it's just a table <a class ="myClass" href="https://example.com">Website</a></td> <td>with two columns</td> </tr></table>
I've got some data in json which have some different geometries in it I want to read these with FME and output geometries, polys, lines, etc I attached the files, do I need to somehow change the way the coordinates are formatted' to be able to create the geometries? How do I best go about this in fme? also have pretty much the same data in xml, attached that too.my plan was to extract the coordinates with attributesplitter but that got troublesome for anything other than a point feature
When I publish a workspace that uses an SDE Connection file where do you recommend storing them? Our IT changes database user passwords regularly and this makes it difficult to keep the SDE connection files published to FME Server up to date.
Hi all, I'm having a problem writing to Azure Cosmos DB where I format the attributes as in the image below and use the Azure Cosmos DB writer to write to the DB. When I test connection and write it says all good however when I go to view the data I get this error and the data hasn't been written. ActivityId: e39bb0d8-2a86-45db-bb62-d50efecc43b7, Microsoft.Azure.Documents.Common/2.9.2' A fatal error has occurred. Check the logfile above for details Failed to specify the feature index as constraints on the reader Cosmos DB (DocumentDB) Reader: Request failed with HTTP status 400. The message from the server is: 'Cross partition query is required but disabled. Please set x-ms-documentdb-query-enablecrosspartition to true, specify x-ms-documentdb-partitionkey, or revise your query to avoid this exception. Any help would be very much appreciated! Thanks Joe
HiCould you tell me the procedure to split csv from a line including a specified text.
I have an strange problem with an Enterprise Geodatabase writer.We just migrated from FME Server 2018 32bit to FME Server 2019.2 64bit.Which also means an upgrade to ArcGIS Pro 2.4.I have the following error with writes to an Geodatabase.An error occurred while attempting to store a row into the table 'GEOEDIT.TennetBekendmakingen_vlak_totaal'. The error number from ArcObjects is: '-2147418113'. The error message from ArcObjects is: {} Watch the ArcObjects error. No clue 'that helps'. I had this error at the end of an processing of WFS data to Geodatabase.To troubleshoot this problem (WFS read has a lot of data so is slow) I wrote te data to insert in the geodatabase to een FFS file.I made an new workspace that reads the FFS en writes to de Geodatabase.In my first attempt the write succeeded.So I decided to implement this on FME Server. Orignal workspace writes to FFS. And the second one from FFS to GeoDb.And then the funny bit starts.I've made an automation
When converting Autodesk Civil 3D data (specifically pipes and structure for creating water, storm and sanitary features in shape or geodatabase) with FME, I am not getting any invert elevations. The newly converted features have some AutoCAD attributes in HEX (assumed) format, but non of them make sense as invert elevation when converted to decimal. The export LandXML file from the same Civil 3D does have those invert elevation that could be read as part of structure description, so it is there, just can't get it out into GIS. I really wanted to avoid the process of manual entry of those invert elevations every time I need to add new developments to the infrastructure features. Any help on that?
A selection of features from an Oracle database by means of an Esri Geodatabase (ArcSDE Geodb) reader gets exported to a file geodatabase. The original database table has an ObjectID field which is unique. However, the reader considers this field as of type Integer. In de exported file geodatabase this field is still of type Integer. A python script compares the original table and the table in the file geodatabase on the basis of a common field of type ObjectID, which obviously fails.Is there a way within FME to change the field type from type Integer into type ObjectID or should I take an alternative route?
Can FME Cloud be configured to access my local network drives? For example, could I read something from ArcGIS Online and write it to a shapefile or FGDB on one of my on premise servers?
Im trying to import a BAG file in a database. A bag file has 2 bands (elevation and uncertainty) and a metadata string. I want to import the 2 bands and the metadata features to their own column in a table. When I try to import the metadata string it imports the whole string to one column called: Bag_metadata_string. I have no experience with the xml transformators. I tried to export the string to a xml file and continue with that xml file to import in a database. It worked almost but not completely. When I export to XML it changes the < > to something like &gm; and &gl;When i changed them back in notepad to < > it could be used to import to a database. Unfortunately it created only the columns and didn't import the data.What is a good workaround to work with a BAG file so I can export the metadata correctly from BAG to postgis?
I have shp files with dbf exceedig 5GB each. While using fme to open it and proces I'm getting an error. I'm using FME 64 2018.1 on windows 64b. I can use Qgis to convert but I would like to know how to handle with such files? Link to the file: https://opendata.geoportal.gov.pl/prg/adresy/PunktyAdresowe/POLSKA.zip