Using readers and writers to extract and load data.
Recently active
I'm working with data held within an attribute which contains a strings of varying length. Within the string the data is grouped within pairs of parentheses. Example of data would be (66) (12.36) (534) (1.6667)The number of number characters within the parentheses does differ within the data hence the reason for this post. (I had thought I'd resolved my issue with by utilising a series of stringextractor transformers).I would normally take the data into excel and replace the ( with blank then perform a text to columns with the ( character but I'm trying to learn more about FME.I require 4 new attributes to contain only:Attribute 1 = 66Attribute 2 =12.36Attribute 3 = 534Attribute 4 = 1.667I'm certain that this will be possible and have read some threads on Regex, unfortunately for me I'm not familiar with this language and have failed so far to use the stringsearcher or stringreplacer to resolve my query.I'm sure other people have come across similar data cleanse
Working with AutoCAD Layouts can't set autocad_viewport_center_point_x support upto autocad_viewport_center_point only
Hi,kindly help me convert from DGN to DWG file.I'm following this procedure:Right click on dgn file -> translate with FME quick translator reader - dataset: I browse the dgn fileformat: automatically recognized to Bentley Map XFM design V8writerFormat: I select Autodesk AutoCAD DWG/DXFclick on OKoutput:DESIGN READER: Opening DGN V8 file 'C:\\00 Enrique\\02 Desarrollo Negocio\\Países\\Suecia\\00 E4 Bypass\\FSE901\\Original\\Export\\001D_FU\\004D_5 Tekniska handlingar\\001D_Samordningsmodeller och beskri\\I100K110\\I100K110-01.i.dgn'DESIGN READER: Error opening Design file C:\\00 Enrique\\02 Desarrollo Negocio\\Países\\Suecia\\00 E4 Bypass\\FSE901\\Original\\Export\\001D_FU\\004D_5 Tekniska handlingar\\001D_Samordningsmodeller och beskri\\I100K110\\I100K110-01.i.dgnA fatal error has occurred. Check the logfile above for detailsFailed to obtain any schemas from reader 'DGNV8XFM' from 1 datasets. This may be due to invalid datasets or format accessibility issues due
I want to use feature merger to merge data from a number of excel spreadsheets that all share a common unique ID. Is this possible? I have had success merging two sheets but when I try to merge a third sheet the new entries appear as 'Missing' Am I doing something wrong?
Hi all, Does anyone know how to import spatial data into Postgre? It seems the option Allowed Geometries is greyed out. Thanks, Darius
Hello,I am wondering if there is a way to define precision for json files generated with the ESRIJSON writer. I am reading from a 10.1 ESRI File Geodatabase, writing to ESRIJSON and get 4 digits after the decimal, where I'm looking for 10. The coordinate system of the reader is web mercator (meter) - I know 10 digits is unnecessary but am trying to match the format of other files. Using the ArcGIS geoprocessing tool 'Features to json' gives me the 10 digit precision.FME 2012, ArcGIS 10.1 SP1.Any help would be appreciated.Thanks
After I generate the file using the glTF output writer, and tried the Khronos glTF validator it presents me with errors.Not sure if anyone else has this problem. In addition, I cannot load using Cesium or threejs glTF loaders.
I am trying to transform an ESRI shapefile to a GML.To generate the GML I use a template/schema (supplied by the recipient). Unfortunately the result does not look like the delivered example . Because of this, the file will not be accepted. How can this be corrected? I am fairly new to this so please try to keep it simple. Below is the template/schema 1) First of all the naming is incorrect, rws:Objecten is expected but gml:FeatureCollection is generated.2) Below that, I expect the xmlns extensions to be underneath each other instead of in one line.3) Also gml:id="GML-ID-0" should be behind rws:Objecten but it is somewhere else.4) It also generates gml:boundedBy, this is not in the source data.5) gml:pointProperty is created instead of rws:puntObject.6) Inside gml:pointProperty, naming and positioning is different. Why is this happening and how can I generate a GML that looks exactly like the example XML format?If you need to see/test it for yourself, . Thanks in adva
Hi,Probably this question has been asked before. ...I have a geometry IFME arc well made in the workbench ( arc by centerpoint, or arc by centerpoint with end points ).When i extract this geometry with GeometryExtractor i didn't obtain a <gml: arcbycenterpoint > description but a <gml: linestring > description. Only exception : arc with 3 points.I used 2Darcreplacer to construct this arc.It seems the only solution to obtain what i want is to write an XML templater with the desired squeleton and put the attributes inside. And when i retrieved the geometry with a geometry replacer + geometry extractor It doesn't change.The problem is when i want to aggregate arcs with lines or with arcs again to obtain a complex geometry. With the transformers inside FME it's well made ( 2Darcreplacer, arcpropertysetter. ...) and i obtain a <gml: surface> made with many parts. ( aggregate in FME workbench made of IFME Polygon with IFME Paths made of IFME arc and IFME L
I am new to FME. We want to use it at our office to convert dwg building models with ACIS solids to IFC models (and the other way around). In the process we want to map every DWG layer to an IFC object type (ex: objects in DWG layer A-42------ are converted to IFC walls).I started trying to convert one of our building models, but the IFC output is only 1,5 kB and contains no geometry.Now I am trying to convert a test file containing only two solid boxes, with the same result, and I can see in the log that the objects fail when the IFC file is written.I have tried to convert the same model to Collada format with success, so there is nothing wrong with the reader side, but something goes wrong (or I have not understood some needed setting) when the IFC writer are doing it's job.My conversion log is attached.Hope someone can point me in the same direction!Cheers, Mikael
Hi,I am trying to transform a dwg (to dwg) but I have a problem with hatch features.I noticed when I have hatches with the acad option "Outer Island Detection " as type, I can't write them into my dwg file output. When I swich it to "normal", then I can. I was wonderring if it is posible to handle this option directly in FME before writing the output as I have plenty of dwg with this problem to tranform.Thank you in advance,Fabien
I've got a MSSQL database that stores JPEG images in a varbinary(max) field. I can of course bring this data into FME desktop with either the SQL Creator or the MSSQL_ADO reader. I also know I can get at the EXIF information using the JPEG reader and exposing those attributes. Where I get stuck is how to get from the fme-binary data into the JPEG reader to expose that meta data. Ultimately I'm trying to extract the GPS coordinates from the JPEG but nothing I've tried has worked. Since this is an ARCmap Feature Attachment table I can't be the first person who wants to extract the timestamp and GPS to verify or update the feature data to which the attachment is associated, but I can't figure it out.
Hi,I have two Microstation V8 file that's suppose line up side by side spatially, but for some reason one file won't line up correctly. FILE_01.dgn looks correct when I view in FME Data Inspector, however FILE_02.dgn shows up as a empty screen. Yet when I open the file in Bently Data Viewer, I can see the data. I suspect it's some sort of Global Origins issues, however, I don't have access to Microstation and not sure how to trouble shoot.Any advice would be greatly appreciated. Regards,Thomas
Hi,I am working on a workflow that can do some simple calculations on different data sets but within just one database of my choosing. Each project has its own database with tables(data sets) and i would like to connect to them by just giving FME the pXXX project number and data set number. I tried to use published parameters to set the same values that i normally use in a more static workflow. This ends up in an error when adding the reader.Undefined macro `database' dereferenced in file `'Program TerminatingTranslation FAILED.Workspace generation failed. Parameter file was C:\Users\Jeroen.GPA\AppData\Local\Temp\FME_1510569791750_7796.Is it not possible to set the database into a parameter or do i need to save it as something else than text? Or is there another way to get dynamic connections to different databases on the same server(login credentials are the same for all tables and databases on that host and port).edit: i, of course, filled in the host, port and other information tha
I can get my Feature Types, but when I connect them to an Inspector, I can't read more than 150000 entities. I get this message : Is this an error because of my parameter ou because of the WFS Data ? I'm using FME Desktop 2017 (build 17652, 32-bits and 64-bits version). My project use only about 300 Mo RAM. I keep the WFS Reader's default parameter, except : Max Feature : 150000 WFS Version : 1.1.0 WFS Output Format : GML 3.1.1 Connection & Transfert Timeout Length : 1000 s If I set "Max Features" to 100000, I can visualise my datas. Thanks for any help or advice ^_^ Patrick
I am trying to manually geocode some addresses, and am having a hard time developing the correct workflow to acheive this. I have a dataset coming from a SQL database that is full of addresses with unknown coordinates. I am geocoding with a CSV file that I have created that contains the addresses compiled from county auditor websites with the associated latitude and longitude fields for each address. I am starting with FeatureMerger because if both address fields are an exact match then this works perfect. -- address geocoded successfully. However some addresses will not match based on different suffix types. (i.e. ROAD vs. RD or HIGHWAY vs HWY) I have added a string replacer transformer to the workflow to trim off the suffixes that could eliminate the addresses from matching via a rubular expression. The part I am struggling with is how do I compare these fields again after I have trimmed off the various suffixes? I have attached a picture of my workflow.
Hello everyone,I've just started my PhD and referencing takes me forever so thought FME could do the heavy lifting. The idea is to have an excel chart (example attached) that I manually fill in with the referencing details and run it through a workspace and at the end I have a full bibliography written to a word document. The process for this is to take the excel file and sort it alphabetically based on authors surname and then filter the attributes based on the type of reference and number of authors. From there I use the MSWordParagrapher to list the Harvard reference format that I wrote in the text editor The problem I have run into is that for the life of me I cannot get more than two MSWordParagraphers working at once. If I link up attributes to a third one I get a failed workspace and I will ideally want around 20. Is this possible? Am I missing something simple? Or is there a better way of doing it?, I've attached the workspace and the source datasets if anyone can help
Is there a way of reading .pts files within FME
Hello everyone,I am back and I have 99% of this very important workbench completed (thanks to you all for helping with last question).My next "issue" is stumping me. My workbench is reading form SDE and writing to a GDB.One of the features I have is a Cutout object and within the SDE is the Cutout_tb (Sde table object) which carries the Child records of the Parent Cutout.I simply bring it in and connect it to feature merger to get the attribute I want (fuse size).Seems simple enough but the Workbench wont read records from the table in the workbench whether I put it in its own reader or not. Its puzzling because if I make separate workbench and simply write to access database it reads and writes the records fine.Is there any way to get the workbench to get the child records straight from SDE upon reading the cutout object (such as reading the SDE Relationship Class object in SDE)? Or is there a way to get the simpler way of simply having the table read in workbench and join
Hi,When we try to create a new feature class using the Esri Geodatabase (ArcSDE Geodb) writer, we get the following error: Geodatabase Writer: Creating feature class `OBJ.Duikers_2017'An error occurred while attempting to create the feature class 'OBJ.Duikers_2017'. The error number from ArcObjects is: '-2147216072'. The error message from ArcObjects is: {Underlying DBMS error [ORA-13224: geen tolerantie opgegeven voor laag in USER_SDO_GEOM_METADATAORA-06512: in "MDSYS.MD", regel 1723 ORA-06512: in "MDSYS.MDERR", regel 17ORA-06512: in "MDSYS.SDO_GEOM_TRIG_INS1", regel 39 ORA-04088: Fout bij uitvoering van trigger 'MDSYS.SDO_GEOM_TRIG_INS1'.]}A fatal error has occurred. Check the logfile above for detailsI think the correct translation for the ORA-13224 message is:ORA-13224: zero tolerance specified for layer in USER_SDO_GEOM_METADATAIn you can find the sql statements that are executed by the trigger MDSYS.SDO_GEOM_TRIG_INS1 that raises the error.The problem seems to be that no toleran
New to FME: need to convert excel csv x,y meter coordinates into dwg file format
I have a JSON file and need to extract the attributes from this file. How can I do it? Example:{ "id" : null, "revisionNumber" : "1.0.0", "periodTimeInterval" : { "start" : "2014-10-10T01:00Z", "end" : "2014-10-11T01:00Z" }, "timeSeries" : [ { "id" : "silo:67688:536653:raw", "name" : null, "tskeys" : null, "dimensions" : { "attribute" : [ { "value" : { "item" : [], "type" : "String", "value" : null }, "name" : "Datenquelle" }, { "value" : { "item" : [], "type" : "Integer", "value" : "0" }, "name" : "Netzbetriebsplanung" }, { "value" : { "item" : [ { "key" : "0", "name" :
A fellow FME user asked me if there are many people using Oracle Cloud and also they were wondering what formats are commonly used in combination with Oracle. I figure you all might be able to help answer this one.