Using readers and writers to extract and load data.
Recently active
I hv to compare geometric and semantic structure of a building object. Please help me to understand this by using a simple building object.
I had a column in postgresSQL which was serial. The column was generated by postgresSQL so I didn't have to input it. After transferring it from serial to integer, I found I couldn't write it to database in FME workspace, which may have already cached previous database information. I inspected the data and figured that all the values of this column were transferred to null when writing to database. To solve it, I deleted the column and recreated it with same name in DB. Then everything works. Is this a bug of FME? By the way I am using 2018.
Help. I'm trying to write several tables (ESRI geodatabase, not file geodatabase), based on a csv on input tables to the identical schema on the output (ie SCHEMA1.TABLE1 -> SCHEMA1.TABLE, SCHEMA2.TABLE1 -> SCHEMA2.TABLE1). My latest attempt is to have connection files for each SCHEMA and generate an attribute with the path to the connection file, then in a featurewriter I set the connection file to be that attribute, but it's only using the first connection file path and ignoring others coming in. This process will expand to other tables in other schema's so I'm trying to make it as adaptable as possible.
Hi, I'm trying to read a fairly complicated XML format that I know nothing about (Government standard, 220 page spec, etc) and don't know where to begin. The Webinar for Reading XML is a bit broken (no video, at least some of the demo's error-out) so I'm stumped. I have a XML (like: http://www.dft.gov.uk/transxchange/schema/2.1/examples/express/express.xml) but FME (either 2012 or 2013) refuses to read it. I get: |ERROR |Unable to configure the XML module to read the XML dataset. No <xrs:switch> item in the xrs document 'C:\\apps\\FME_2013_64\\xml\\xrs\\xrs.xml' matched the XML dataset 'C:/Users/jmou1.WCC-CORP/Desktop/20121128 WarwTT/twm_8-201_-1-y11.xml' |ERROR |The XML format could not be determined by examination. Try entering a feature path into the "Elements to Match" parameter, specifying an xfMap, selecting an XRS, or using a more specific reader While there is a XSD collection (http://www.dft.gov.uk/transxchange/schema/2.1/T
Hi! This has been covered in part, but I would like to expand. The way to write to a specific schema in PostGIS is to use what FME calls 'table qualifier'. However, this setting is disregarded in DYNAMIC mode, and defaults to the public schema. Is this a bug, or by design? I am trying to set up a standard method for PostGIS writing, which should be able to convert 30-50 shapefiles to a specific schema. Doing the same with the writer in static mode works, but becomes very impractical. I am aware that you can alter the writer settings for all flows, but any processing in beteween, such as creating an UUID must be applied to all flows one by one. Regards, Mats.E
I am pasting in a linked table from Excel to CAD. I format the table and then lock it. Once I close and re-open the .dwg, only the rows before the table break have kept their formatting. Why is the entire table not keeping its format?
I am creating a huge raster (10GB FFS). I need to save this as an FFS and then read it with different other workspaces and apply the raster as a texture etc.Is there a better way to store the "temporary raster" ? Switching to JPEG does not work, TIFF will be to large and ECW will be too slow.Due to memory issues I can not have the whole raster in memory.
I have created an FME script that takes a file path as an input and copies it to a folder using the File Copy writer. I have tested it in FME Server and it works.However, I have a custom web page with an ajax transaction that uses the FMW script in FME Server as the server side program, and this doesn't work. The message says "Cross origin requests are only supported for protocol schemes: http, data, chrome, chrome-extension, https", although both the HTML page and the FMW script are on the same machine. Is it possible to upload a file this way, or do I have to use the FME Server interface?
Hi all,I am on FME Server 2018 and try to modify the Directory Watch example (https://knowledge.safe.com/articles/51817/directory-watch-publisher-tutorial-2017.html) so that the uploaded data gets imported into a postgis database. But I am not sure about this approach:1. is the easyTranslator2 workspace suitable for writing to postgis?2. Where would I set the credentials for the database?3. How ist the schema creation done, and how can I decide wether to import into an existing table or drop it and create it new?Certainly beginners questions, so I would be more than happy if someone could shed light on this.---Markus
Hi,I have an excel reader and i convert that to a shape file, which will then be published as a feature service to ArcGIS portal. I will be using this workspace multiple times and will be using new excels each time. My problem is that when i add a new excel the parameters previously specified for the excel before it do not stay the same (i need to specify x and y coordinates).So when i publish my data to a Portal feature service, my points do not appear on the map but they are in the attribute table.Is there anything I can do that will just set the parameters for me each time? so i dont have to add a new excel reader and specify x and y coordinates as the data type each time? I just want to be able to click run with prompt and then select my excel then.Thanks in advance for your help
I have several county-wide 4 band GeoTiff imagery datasets that I need to review. Sometimes I identify the exact same image in two different tiles. I would like to automate a method for identifying this error. Does anyone have a workflow for identifying this or have any ideas on moving forward?
I'm on Windows 7 and I have a workspace (FME Desktop 2017.1.0.0, build 17539) that connects to a SQL Server enterprise gdb to export a handful of feature classes to a file gdb. The enterprise gdb is not versioned and is located on a server within my network, though not in my office, and I'm exporting to a file gdb on my machine. It's been working fine up until about a month ago, when I started getting errors. This is the error I get when running the workspace: "Could not open the Enterprise Geodatabase. The error number from ArcObjects is: '-2147216100'. The error message from ArcObjects is: {FDO error: -2147216100} Please ensure the connection parameters are correct (server=`server_name', instance=`instance_name', user=`username', password=`***', database=`database', version=`SDE.DEFAULT')"I can use the same parameters and connect to the gdb in ArcCatalog and ArcMap and can view feature classes within it. I've tried using
Hi All, I am using a reader that is connecting to Microsoft SQL Server Spatial if I connect an Inspector and run in the workbench, I get the following error on some (not all) of the data. Can anyone shed some light why this might be happening? As far as I can tell the spatial data is fine and the missing data does show in other applications such as CAD and ArcGIS (using a view) and in SQL Server Management Studio itself. MS SQL Server (Spatial) Reader: Failed to write to the database because it could not be converted from Well Known Binary format to geometry MS SQL Server (Spatial) Reader: Failed to deserialize SQL Server geography binary: `0xBB100000020411000000D91B626FD3E43AC0D0F4B58B2AD062405D25081ED0E43AC03F9DA6BD2AD06240C0AC0D81CEE43AC0CCD91FF92AD06240CCB6CE8ACEE43AC03318DE472BD062409A332FC4D9E43AC0DFD2A9FD2ED06240147DD465DEE43AC0D7CD11A52FD0624066497962E5E43AC084BC4EA62FD06240AAFAF5E1F8E43AC04A1CD2802ED06240B0122D36FBE43AC067BC3B812ED06240931464C1FCE43AC0691909B92ED062
Hi, I use FME 2014, and tried with quick translator to migrate popular AdventureWorks MS database to PostgreSQl server. First I created PG database: CREATE DATABASE adventure_works_2012 WITH OWNER = postgres ENCODING = 'UTF8' TABLESPACE = pg_default LC_COLLATE = 'C' LC_CTYPE = 'C' CONNECTION LIMIT = -1; Then I added neccessary schemas, to allow FME Quick Translator do it's job. However I get this error: Bulk copy failed on table 'Production.Product' using delimiter ':'. Error was 'ERROR: invalid input syntax for type numeric: "2,24" CONTEXT: COPY Product, line 210, column weight: "2,24" ' and I don't know where could this come from. Looking inside database in SSMS I don't see such separot on the field, it's "2.24", and my regional setting also doesn't provide comma as decimal separator, so I don't know where does FME pulls this value and makes process fail. Thanks
Converting from SQL to AutoCAD Map 2018 with the OD writer. I've exposed both the autocad_map_odtable and autocad_layer format attribute then created the correct values. Everything looks good as far as primary OD Table Name and Layer Names. Except that I get the OD Table Name set through the exposed format attribute in addition to a OD Table Name for each of the new layers defined. My understanding was that by exposing setting both the layer and OD Table format attributes that the writer would suppress or only create on OD Table name?
I am trying to write out some “UK Flood Security” polygons obtained from an API to my ArcGIS Online account as a new Feature Service. I keep getting an error that the “Geometry Type: Unknown (0) and “No geometry mapping entry found for 'esriFieldTypeString(200)' in metafile 'C:\\Program Files\\FME\\metafile\\ARCGISONLINEFEATURES.fmf'. A fatal error has occurred. Check the logfile above for details.”The FME ArcGIS Online Writer has geometry set to Polygons. That is the data type I see coming from the API.
Hi, i want to delete a shape file after publishing it to a feature service on ArcGIS portal? would appreciate if anyone could help.So before that i have converted an excel to a shape, then a shape to a feature service but i want to delete that shape after
I have created a custom reprojection to reproject from ETRS89 to London Survey Grid. However this currently only takes care of the x y coordinates. I would like to create a grd file of the ellipsoid to orthometric height adjustments. I have created a grid of points with the height adjustment values but don't know how to get that into a format that CSMapReprojector can use. Alternatively, does someone already have a grd file for ETRS89 to OSGB?
Hi, I have a dataset with features containing three attributes. Each feature contains a text string such as SAINT PATRICK'S CLOSE (see below)or 'stacked' text, which contains carriage return and line feeds such as Saint Patrick's Cathedral (see below).Using the complex example provided by Safe i've created Tags for each attribute. Basically I need to retain the GUID, FORM_ID and FUNC_ID values on each feature in the DGN. When I write out the DGN file, all works perfectly with the liner text string. It retains the GUID etc tags and values. See below.The feature with the stacked text string gets split into five elements - one of each line of text and one for each carriage return/line feed.This would be ok, but none of the five output elements have any tags. I assumed each element would have retained their GUI, FORM_ID and FUNC_ID tags when written, but it seems all tags have been stripped instead. Is there any way to retain the required tags even though my feature get
By clicking "Download List" button, a CSV file can be downloaded from a web portal. I tried to extract the data by using HTTPCaller. However, the url is not in the html and the CSV is generated with JavaScript. Does anyone know how to extract data? Thanks!
I'm trying to visualize a scene using the FME Augmented Reality (AR) writer.As an Input I have a point cloud, and have shifted the origin with Offsetter. I used a PointCloudSurfaceBuilder to get a 3d object in the scene.The resulting model is full of holes, and the color attribute is not preservered, and although crude the model is with holes.I would like to know if some have had more succes and have been able to add the color information to the model?
I have a csv file that is used as configuration for various database schema attributes. Against each layer name there are a a set of fields and a set of values that are valid for the field.I have a workspace that can check if the database contains values that are outside the permissible range:However, this only works for a single row. What I need to do is to loop through the csv file processing each row individually like a recordset.Is this sort of behaviour possible in FME? I have seen some posts on looping but nothing that really fits what I am trying to do.
Hi! I am converting GIS data to GeoJSON files. Currently the GeoJSON files are within the JSON file. Is it possible to separate the JSON file so I can see the GeoJSON files along with the JSON file. Essentially, it would look like the image attached. Thank you for any help!David
I have backup copies of layers in an ArcSDE database, using two digits for the month (01, 02, 03, etc), in order to detect change from the updated versions. Is there a way to have the reader switch to the next month's backup by checking the system date so I only have to press play and not change anything other settings?
Is it possible to create a 3D model from a PDF?