Using readers and writers to extract and load data.
Recently active
Hello,I´m trying to find the way to read DGN v7 file settings - - What units are set as master and as sub units? Is there any attribute, which is able to identify these units settings?- Is it possible to detect origin of coordinates of design file? E.g. I have condition that origin of coordinate system of design file have to be set to XXX, YYY.- I read that FME desing file reader v7 doesnt support file attribute igds_element_view_independent, but desing file v8 does. Why? I´m not DGN file expert, but is it caused by the reason that dgn v7 completely doesnt support view dependent parameter?Thank You so much!Lubo
I am fairly new to FME and I need to convert a GEOJSON data link to a file geodatabase. I have not be able to find any help online for where to start.Data link is here: https://data.menlopark.org/resource/vdp2-yzq3.geojsonAny help would be appreciated.Thanks!!
Hi!I am trying to write to a AZURE SQL non-spatial database, but I received the below error for just one of my layers. "Microsoft Azure SQL Database Non-Spatial Writer: Failed to write a feature of type `dbo.door' to the database. Provider error `(-2147217887) Invalid character value for cast specification'. SQL Command `INSERT INTO dbo.[door] ([id], [category], [restriction], [ordinal], [name], [alias], [address_id]) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?)'" I've checked the datatypes to see if they match and they do along with the attributes. Could this be a geometry issue? I do not know what else to check for.Thank you for any assistance!David
I am looking to convert a CAD layer to a point shapfile. Below is the data in inspector the highlighted field are the Value I need to capture in my new Shapefile.
I am trying to connect to an external database using a web call service through the EPA (located here: https://www.waterqualitydata.us/portal), but when I use the link from the web service at the bottom of the page under "Show Web Service Calls", i get this error. I think this has something to do with the fact that the service sends the data pulled in a Zip file, and FME can't get passed that to get to the data? Here is the "logfile" that I get after I try to pull it. The file is an Excel File, but again it is bundled into a Zip file: Starting translation... FME 2017.1.0.0 (20170731 - Build 17539 - WIN32) FME Database Edition (floating) Permanent License. Machine host name is: D22761 Operating System: Microsoft Windows 7 64-bit Service Pack 1 (Build 7601) Copyright (c) 1994 - 2017, Safe Software Inc. Safe Software Inc.Pote
Has anyone got expereince of writing direct to a gmap file?I can write to kml then import into gmaps which then creates the gmap file but wanted to know if I can simply write to gmap and update the layer automatically. ThanksSeb
I read a shp file, and work with the Extruder transformer , after that write to a geojson file, but geojson's geometry type is "MultiLineString", I want to set the geometry type of "MultiPloygon", how to set?
The task is to read a postgis table (fully qualified namespace.tablename) from one database and write it to another database into the same namespace and with the same tablename. Table name and namespace are not known beforehand but get submitted in the form namespace.tablename as a parameter at runtimeI have successfully created this JobSubmitter workspace:which, according to this logfile runs successfully.The server workspace postgis2postgis.fmw looks like this:and when run, fails for reasons unknown to me. The server log is this: I cannot figure what I've misconfigured here, so any help would be greatly appreciated.
Hi there. Using a CSV to drive a process that will copy various featureclasses in various schemas to corresponding schemas in a postgres DB. Using a workspacerunner fed the input connection file, the output connection file, and the schema and tablename. Some variations have almost worked, but invariably none of the attributes transfer over and there are too many attribute columns. Please advise.Thank you.
i have a wms server background map service i use it with data driven page in arcgis to generate a multiple pages PDF file format how can i make it with fme desktop... notice that i have an aggregated shp file ready to be used and i also tried to put the wms server from the background in the inspector because when i put it from the work space it doesn't run well.Thanks
Hi,I have been using the sql executor to run a sql server stored procedure which populates a table, I then try to use a feature reader to read from the table that has just been populated. Alas it times out. If I do either of these components separately it works leading me to believe FME is holding the connection open to sql server and creating a lock on the table, so that when the reader tries to read it can't. I am using the SQL Server JDBC Client. I will try with the Native Client but this will mean I can't use it with fme cloud which is what it is intended for. Has anyone else had this issue? Working log and failing log are attached.Many Thanks as always
hola, queria saber de la manera mas fácil, como restar de dos ficheros lidar los valores de las Z. Realmente es el mismo lidar, lo que uno es solo con la clasificación 2, el otro con todas las clasificaciones. donde el resultado sea que se represente las alturas o elevaciones de los objetos respecto al suelo. he llegado poder hacer la resta de las Z, pero no he podido cambiar el valor de la Z calculada con la que tiene el punto. ¿como puedo cambiar la geometría de la z vieja con la calculada?Hello, I wanted to know in the easiest way, how to subtract from two LIDAR files the values of the Z. It is really the same lidar, what one is only with the classification 2, the other with all the classifications. where the result is that the heights or elevations of the objects are represented with respect to the ground, I have come to be able to do the subtraction of the Z, but I have not been able to change the value of the calculated Z with the one that has the point originally. How can I cha
I'm having some difficulties with writing Welsh characters to a MapInfo Professional file and was wondering whether anybody could help?I'm taking OS MasterMap Topographic data in gml format, in this case specifically looking at the Cartographic Text theme, this is then getting written out to a MapInfo Professional TAB file. The issue is that the Welsh characters are being shown as '?' when the file is then viewed in MapInfo Professional (or QGIS).I've tried using both the MAPINFO and MITAB versions of the writer, the MITAB writer does offer a character encoding option but neither UTF 8 or 16 are in the list of available options. I also tried using an Attribute Encoder but this was pointless as the encoding within the FME process does appear to be UTF, it's the writer that is converting everything to, in this case, Windows Latin1 (the system default I believe).Following a little more research it looks like later versions of MapInfo Professional do support UTF,
I want to set the PostGIS namespace dynamically, derived through a RegExp from the SourceDataset_GENERIC parameter, however all my imports end in the 'public' namespace.
Hi,"Shared FME Folders" is a great way to share setups between 32/64 bit instances, between versions, even between colleagues on a network drive if warranted.It seems that there are much documentation on how to share database connections and coordinate systems using these "shared folders". And I even got the shared "Transformers" working.But how do I add and share a Python based custom format using "shared folders" ? Apparently not by just copying the formats folder into "Formats" !It seems that information about formats need to be stored all over the place, typically under "FME_HOME", which is of course not shared. I've seen format information stored in sub folders "formatsinfo" and "metafile", and the format functions themselves (py/pyc files) need to be in a 3rd place.Are there any comprehensive documentation on how "shared folders" work ? And on whether it can fully accomodate custom forma
I hv to compare geometric and semantic structure of a building object. Please help me to understand this by using a simple building object.
I had a column in postgresSQL which was serial. The column was generated by postgresSQL so I didn't have to input it. After transferring it from serial to integer, I found I couldn't write it to database in FME workspace, which may have already cached previous database information. I inspected the data and figured that all the values of this column were transferred to null when writing to database. To solve it, I deleted the column and recreated it with same name in DB. Then everything works. Is this a bug of FME? By the way I am using 2018.
Help. I'm trying to write several tables (ESRI geodatabase, not file geodatabase), based on a csv on input tables to the identical schema on the output (ie SCHEMA1.TABLE1 -> SCHEMA1.TABLE, SCHEMA2.TABLE1 -> SCHEMA2.TABLE1). My latest attempt is to have connection files for each SCHEMA and generate an attribute with the path to the connection file, then in a featurewriter I set the connection file to be that attribute, but it's only using the first connection file path and ignoring others coming in. This process will expand to other tables in other schema's so I'm trying to make it as adaptable as possible.
Hi, I'm trying to read a fairly complicated XML format that I know nothing about (Government standard, 220 page spec, etc) and don't know where to begin. The Webinar for Reading XML is a bit broken (no video, at least some of the demo's error-out) so I'm stumped. I have a XML (like: http://www.dft.gov.uk/transxchange/schema/2.1/examples/express/express.xml) but FME (either 2012 or 2013) refuses to read it. I get: |ERROR |Unable to configure the XML module to read the XML dataset. No <xrs:switch> item in the xrs document 'C:\\apps\\FME_2013_64\\xml\\xrs\\xrs.xml' matched the XML dataset 'C:/Users/jmou1.WCC-CORP/Desktop/20121128 WarwTT/twm_8-201_-1-y11.xml' |ERROR |The XML format could not be determined by examination. Try entering a feature path into the "Elements to Match" parameter, specifying an xfMap, selecting an XRS, or using a more specific reader While there is a XSD collection (http://www.dft.gov.uk/transxchange/schema/2.1/T
Hi! This has been covered in part, but I would like to expand. The way to write to a specific schema in PostGIS is to use what FME calls 'table qualifier'. However, this setting is disregarded in DYNAMIC mode, and defaults to the public schema. Is this a bug, or by design? I am trying to set up a standard method for PostGIS writing, which should be able to convert 30-50 shapefiles to a specific schema. Doing the same with the writer in static mode works, but becomes very impractical. I am aware that you can alter the writer settings for all flows, but any processing in beteween, such as creating an UUID must be applied to all flows one by one. Regards, Mats.E
I am pasting in a linked table from Excel to CAD. I format the table and then lock it. Once I close and re-open the .dwg, only the rows before the table break have kept their formatting. Why is the entire table not keeping its format?
I am creating a huge raster (10GB FFS). I need to save this as an FFS and then read it with different other workspaces and apply the raster as a texture etc.Is there a better way to store the "temporary raster" ? Switching to JPEG does not work, TIFF will be to large and ECW will be too slow.Due to memory issues I can not have the whole raster in memory.
I have created an FME script that takes a file path as an input and copies it to a folder using the File Copy writer. I have tested it in FME Server and it works.However, I have a custom web page with an ajax transaction that uses the FMW script in FME Server as the server side program, and this doesn't work. The message says "Cross origin requests are only supported for protocol schemes: http, data, chrome, chrome-extension, https", although both the HTML page and the FMW script are on the same machine. Is it possible to upload a file this way, or do I have to use the FME Server interface?
Hi all,I am on FME Server 2018 and try to modify the Directory Watch example (https://knowledge.safe.com/articles/51817/directory-watch-publisher-tutorial-2017.html) so that the uploaded data gets imported into a postgis database. But I am not sure about this approach:1. is the easyTranslator2 workspace suitable for writing to postgis?2. Where would I set the credentials for the database?3. How ist the schema creation done, and how can I decide wether to import into an existing table or drop it and create it new?Certainly beginners questions, so I would be more than happy if someone could shed light on this.---Markus
Hi,I have an excel reader and i convert that to a shape file, which will then be published as a feature service to ArcGIS portal. I will be using this workspace multiple times and will be using new excels each time. My problem is that when i add a new excel the parameters previously specified for the excel before it do not stay the same (i need to specify x and y coordinates).So when i publish my data to a Portal feature service, my points do not appear on the map but they are in the attribute table.Is there anything I can do that will just set the parameters for me each time? so i dont have to add a new excel reader and specify x and y coordinates as the data type each time? I just want to be able to click run with prompt and then select my excel then.Thanks in advance for your help