Using readers and writers to extract and load data.
Recently active
I have a workspace that reads from a text file where each line is the path to a shapefile. I then have a workspace runner that passes each path to a second FME script as the [SourceDataset_SHAPE] parameter. The second FME script opens the shapefiles one by one and does some processing. This works well for formats like shape, DWG, and geojson, but it doesn't work for Excel because the FME script that gets sent the parameter doesn't know which sheet name to open. I can't seem to pass the sheet name as a parameter, and the sheet names are different for each Excel that I sent to this script so I can't hard code it. Is there a way to send that sheet name to the FME script and have it open the Excel and read from the desired sheet name? Thanks
I have problem reading SHP-file when i run workbench on FME-server. The same workbench runs without problem on the same machine in FME-desktop.I get the error:BADNEWS: Shape Reader: Failed to open dataset '\\\\sv101\\webkartor\\ValsProd\\PPL_PPL_Y.shp' which is neither an existing file nor directory (shapread.cpp:307)Shape Reader: Failed to open dataset '\\\\sv101\\webkartor\\ValsProd\\PPL_PPL_Y.shp' which is neither an existing file nor directory (stftrans.cpp:275) - (..\\..\\..\\foundation\\framework\\engine\\reader.h:130) - (shapread.cpp:307)
I'm reading an FGDB point feature class containing single points but the geometry type has been incorrectly set as "multipoint". I thought I would need to fix this in my Workspace as I'm then sending the data to FeatureMerger to compare (attributes & geometry) against an older version of the data where the geometry type is set correctly as "point".So I used GeometryRefiner which appears to output the "multipoint" features as "point" features.However, FeatureMerger doesn't seem to need this. It produces the same results without using GeometryRefiner as it does with it. Happy days.Maybe Matcher would be less tolerant and GeometryRefiner would be needed there...?
I have a oracle special data from database one which looks like below, it was a label or a text something. MDSYS.SDO_GEOMETRY(2001,82232,NULL,MDSYS.SDO_ELEM_INFO_ARRAY(1,0,6001,11,1,1),MDSYS.SDO_ORDINATE_ARRAY(360.784660012623,0,0,1,131072,16,7209045,7602281,3211296,655373,630758.221843477,5523011.93164305))and I want to copy it to database two with FME.I added an AttributeExposer as a transformer to expose oracle_element{}, and added a ListExploder to list _element_index for the oracle_element{}. I also set geomedia_text_font_size to 0 with another AttributeCreater. But the result I got was always something like below:MDSYS.SDO_GEOMETRY(2001,82232,NULL,MDSYS.SDO_ELEM_INFO_ARRAY(1,0,6001,8,1,1),MDSYS.SDO_ORDINATE_ARRAY(360.784660012623,0,0,1,65536,4,437918234,630758.221843477,5523011.93164305)).It seems the source data saved the geometry_text_string with 16 bytes, while the target data saved it in 8 bytes. My question is that is there any transformer or any way to copy the source data
I am trying to write a polygon dataset to an ArcSDE database, but it is failing on one of the features!2016-11-17 18:59:51| 130.7| 3.7|ERROR |An error occurred while attempting to insert a row into the table 'citystreets' using a cursor. The error number from ArcObjects is: '-2147215968'. The error message from ArcObjects is: {Linestring or poly boundary is self-intersecting}I am using a GeometryValidator, but it isn't picking up any errors! What can I do?
Is there any workaround to export 3d pipes from revit to postgis 3d? I installed the fme plugin to revit and exported into ifc with various options on but none of the exported files contained (or at least I couldnt find). My and goal is to export 3d pipes with various attributes + the 3d geom into postresql/postgis and visualize it in augmented reality (augment . net) Could you provide me some help how can I export pipes from revit to postgis 3d?
This morning, FME Server started to throw errors writing <NULL> values to numeric values using the ArcGIS Online Writer. Everything was working until Esri upgraded AGOL overnight. We've submitted a ticket to Esri, but wanted to submit a question here as well.The error we're getting is: ArcGIS Online Feature Service Writer: 'addResults' error for a feature in 'AVL DB'. The error code from the server was '1000' and the message was: 'Attribute 'Right Wing Plow State' has an invalid value of ''. The value should be data type esriFieldTypeDouble.'We were able to successfully add a feature via the REST API using the following:[ { "geometry" : {"x" : -94.44920, "y" : 41.88339}, "attributes" : { "LABEL" : "Test Insert", "RIGHTWINGPLOW" : null, "ACTIVE_MATERIAL" : "NONE" } } ]Does anyone have the syntax needed
Hi.I have to store a raster (ECW format) in a MBTILES (the writer is SQLITE).The raster looks like this:My first FME attempt has been this one: The MBTILES format needs two tables in the database: tiles and metada. FME builds the first one and then I create the second one with SQLite Browser. After renaming the database from .sqlite to .mbtiles, I add the file to QGIS to see the result: The bigger the zoom the crazier the puzzle.I have almost zero experience with FME and I don't know what I could do to fix this.Does anyone know what is wrong with the process? Or is there a better way to get a MBTILES from a raster?Thanks for your help!
Hi,I need to reproject feature coordinates (with ReframeReprojector) coming from an Oracle Spatial Object reader and therefore want to exclude feature types that are views from being reprojected.Manuel
Hello fellow, GISers.Simple yet complex problem. I want to export 1 feature per table for a schema in my PostGIS-database for test purposes. I want to output the data to shapefiles with filename=table name and output folder=schema name. I want the whole setup to be dynamic since I want to run it later on all my schemas (a schema list). This seems more tricky than I thought it would be. Any ideas?
I'd like to place output from a writer directly into a feature dataset. Is this possible using the existing canvas based tools, or with Python?
Hi! I am trying to get watertight solids from city roof data for 3D-printing. It seems as if somehow many of the solids from the extruded roof polygons sticks together and greates a mess that no 3D-printing software can handle. I have tried countless ways to get around this but it never gets better than this simple workspace. Does anyone have a clue what might be causing this? - The initial polygons are defined as IFMEPolygon in the inspector, and the output is set to .obj - None of the initial polygons are vertical. - In the inspector from the extrusion all is well, the extrusions seems to be independent solids).- In the obj most of them somehow gets mixed together?I feel I must be missing something really simple./Robin
The obj reader includes parameters for files to be used for co-ordinate transformation. What are the format and extensions for these files.
Is it possible to spatially filter a LAS file using a 3d object? I have created a multipatch 3d AOI in ArcGIS expecting to be able to do 3d spatial analysis with it, but appears that LAS datasets cannot be used with the 3d Analyst extension - Inside 3d tool.Is this possible in FME? I have tried spatial relator but that does not seem to achieve what I am after.
Hi,One of the things I currently have to work on is checking if points from an Arc shapefile are within their proper postal code. I normally have to check this visually, but a coworker suggested I may be able to do this check in FME but he doesn't use it so could not really give any input as to how to do it.Basically, there are points that have a postal code assigned to them in their attributes and polygons that outline those postal codes.Looking at the software I was thinking this would be done with the PointOnAreaOverlayer transformer but I cannot figure out how to tell it to check if, for example, the point with postal code 62025 is inside the 62025 polygon.Any help with this would be greatly appreciated.Thank you.
Hi all,I'm interested in writing CityGML that comprise fairly complex relationships between features. From my current experiments It seems like producing nested structures is difficult, at least when using the in-built CityGML writer, and I have not been able to work this out. For example, I have been testing the IFC to CityGML workspace from the 3Dtutorial [1]. One part of this converting the IFCFurnishingElement and IFCBuildingProxy to the CItyGML BuildingFurniture type. According to the CityGML UML , the furniture type should be navigable from room which should be a part of the building. However it seems these features are skipped when writing out the file (even though features are counted up going to the writer). My end goal is to understand how to populate ADE attributes from the energy ADE xsd. While I can successfully write out feature types for the ADE with some attributes, I don't understand how to nest the features with each other. For example, ThermalBoundary composi
Hi all, I'm hoping to use FME to replicate from our internal ESRI SDE (i.e. the FMW running as scheduled task sitting on our internal server) to a geodatabase that sits on a cloud server. To connect to the folder for the geodatabase I need to enter a Username and Password. As the task scheduler runs when I'm logged off the server the credentials need to be stored with the FMW rather than just a mapped network drive on Windows. Has anyone had any experience connecting to remote folders via FME or storing username/passwords within the writer properties? Some guidance would be great. I'm fairly new to FME. Thank you :)
Hello, I am FME beginner and non CAD drawing user. I have a task to convert point features in Excel spreadsheet to CAD drawing. The drawing should contain the attributes too.After viewing the tutorials, I am able to create the CAD drawings. The attributes can be viewed in Data Inspector, however it cannot be viewed in Autocad LT 2016.I am attaching the workspace for reference. Please review and let me know if I have missed any steps?Thanks in advanceRegardsVidya
Hiwhy FME writes stroked Arcs (so there are many linepices) into DWG?I have a very simple translation. And if I insert an inspector right before the writer there are still arcs. But in the DWG are all arcs stroked. Why? Is there a parameter or setting to give?Thanks for your help.
Dear FME community,I have a MapInfo text dataset and created polygons which are the bounding box around that text. The problem is that the polygons have different heights. What I want is that the height of the areas is the same. The length of the area can vary according to the text length. For example: The bbox of "NL Plauen" in the lower left should be as high as the bbox of "NL Zschopau" in the center (in the image it is slightly smaller). Or another one: The three areas of "Stadt Leipzig", "Stadt Chemnitz" and "Stadt Dresden" should be the same height. Because of the different sizes of the letters, the BoundingBoxReplacer creates different polygons.I already tried it with the bufferer, but this one increases the size at every side. I only want to increase the height, not the length.Any ideas of how this can be achieved?Kind regards and many thanksThomas
Hello.I need to apply some formatting to an excel file (borders, fontstyle and so on). So far I use a template but the solution is not perfect because I don't know in advance some details like, for example, how many rows will be written. Can I run a macro written into the template to accomplish these tasks? A shutdown python script?Suggestions?TIARoberto
Hi,I have a xml document (someName.conf) which is not valid. like:<?xml version="1.0" encoding="ISO-8859-1"?> <application name="...."> <component name="...."> <setting> <!-- any comment --> <name>Explorer.Service</name> <value></value> <enabled>false</enabled> </setting> <setting>.... and so onI have no xfmaps or other schemas.I used different readers (generic and xml) and used some transformers like xmlFlattener but can't find to extract xml element/item with attribute. output excel file should look like column a -> commentcolumn b -> namecolumn c -> valuecolumn d -> enabledI`m using FME Desktop 2015.1Any hint? thanks
I have exposed the fme_feature_type attribute.I am then using the FeatureWriter to write this feature class (FGDB) to POSTGIS.Its new name in POSTGIS is @LowerCase(@Value(fme_feature_type))_load.My next transformer is the SQLExecutor where I am trying to find if the above table already exists but doesn't have the _load at the end and DROP that table if it does existSo for example. I am loading Cities_load but want to drop the existing Cities table if it exists and then RENAME the Cities_load to Cities.What would my SQLExecutor read?DROP TABLE IF EXISTS @ReplaceString(@Value(_feature_type{0}.name), '_load', ''); ALTER TABLE @Value(_feature_type{0}.name) RENAME TO @ReplaceString(@Value(_feature_type{0}.name), '_load', '');The above SQL doesn't seem to work correctly...
I am attempting to connect to a SharePoint online site using the SharePoint reader For several days the sharepoint reader throws an '403 Client Error' with the same workbench which worked correclty a few days before. We are using SAML to authenticate and user and password is proved as up to date.error log:DEBUG: Microsoft SharePoint List Reader: {u'error': {u'message': {u'lang': u'de-DE', u'value': u'Zugriff verweigert. Sie haben keine Berechtigung, diesen Vorgang auszuf\\xfchren oder auf diese Ressource zuzugreifen.'}, u'code': u'-2147024891, System.UnauthorizedAccessException'}}Microsoft SharePoint List Reader: Client-side error: '403 Client Error: Forbidden' returned from SharePoint. Error message was: '%2' BADNEWS: A fatal error has occurred. Check the logfile above for details (dynaread.cpp:265)Has anyone any idea how to solve this issue?Thank you.