Using readers and writers to extract and load data.
Recently active
Hi all, After some investigation I found out my Excel reader file contains "line breaks" causing FME to write the content of a single Excel cell to multiple lines. Is there a way in FME to clean line breaks? Thanks, Ed
Generate Unique id in ArcGIS for Sql database.
Hi, I have a problem with writing components to a pointcloud (.csv) file. I made a workbench that merge 2 pointclouds using the pointcloudmerger. The pointclouds contains depth information of a river and represent 2 different periods. There is partly geographic overlap of the information so a made a merge that results in 3 outputs (merged based on X and Y, not merged and unreferenced), with a pointcloudCombiner the 3 outputs will be combined to 1 pointcloud and a pointcloud writer write the new created pointcloud (.csv). The problem is that in the new pointcloud only a few components (x, y, z and z_last) were stored. The original pointclouds contains a lot more components (depths from every measuring period and more) and I see these components in the data inspector but not in the new created pointcloud, is there a possibility to store the original components also in the new created pointcloud? The attached picture shows the output of the new created pointcloud and the data as shown in
i need export alias from a empty gdb. How i can not read any feature. how can i do to export it... thanks
I have exported some buidlings in format CityGML from a different software. The format contains no semantics or attributes and I therefore want to continue to work with the file in FME.When I view the file in Data Inspector I can see the buildings in 3D and I see that it is a IFMEBRepSolid. However when I try to work with the file in Workbench (e.g. transforming CityGML -> CityGML or try to run through GeometryValidator) I get message "There is no geometry in this view".And clues to what can be wrong? I have attached a sample of the 3D-buildings. I am using FME version 2016.1. Thank you!
Hi,I need to georeference a tiff image of a town in Illinois in WGS 1984 Web Mercator (auxillary sphere). The county's data is in NAD 1983 StatePlane Illinois East FIPS 1201 Feet. ArcMap's georeferencing tool is not able to accurately make the tiff image into a map and I think the difference in projection is the reason. So I have downloaded the map of the town from OpenStreetMap. I did a conversion in FME of the attributes I thought would be relevant: Here's the output for the highways attribute in Inspector with Inspector's Background Map:Here are the format attributes I am exposing:The geometry for every attribute is point. I do not understand why a boundary, highway or a route would be represented by a point. Highway has the most features and the other attributes' features all occupy the same spot as a highway feature. My goal is to get a map that in web mercator spheroid projection that I can use to georeference the tiff image. Is this possible? Thank you..
Hello.I'd like to convert LandXML to CityGML. I've tried a direct conversion, but the CityGML Feature Writer is writing geometries that are unsupported by Cesium.How can I extract the coordinates out of the LandXML and write a CityGML line string?
Hi.My model is complicated and I need to simplify it.If FME can do the job, I will be grateful.Thanks a lot.
Hi,Just wondering if anyone had any success reading data from the ArcGIS Online Living Atlas? Thanks
Dear FME community.I try to integrate data into ORACLE but FME say me : error was `ORA-29875: failed in the execution of the ODCIINDEXINSERT routineDo you know what does that mean ?Thanks
I have a table with three attributes: NAME, LOCATION, and AREA. I want to get the row with the largest area, for each name. In Oracle, I can do so with this query: select name, location, areafrom ( select name, location, area, max(area) over (partition by name) as max_area from mytable)where area = max_area I could put this into a SQLExecutor, but I'd like to be able to do this even if my data source isn't Oracle. Can I accomplish this using FME transformers instead?
Has anyone got a workaround for updating a hosted feature layer without effecting the edit date? I have had multiple editors updating many hosted layers for over a year. I now need to change some attributes on a large scale (+30k records). Ive been able to create a simple workbench using the feature merger to achieve my update. The issue now is loosing the historic, editor and edit date attribute. Many ThanksMick
Using the said reader I configure my parameters as shown, FME returns with the folder list from Box below When I run my workspace I get this error If I use the BoxConnector transformer it can only read one folder URL at a time but using the same web connection works. All I want to do right now is build a folder list that reads the sub folder recursively. Later I'd like to use the exifreader to get metadata of the pictures stored in Box.
I have some XML data in the structure<a> <b> <e>data1</e> <e>data2</e> </b> <c> <e>data3</e> <e>data4</e> </c> <d> <e>data5</e> </d></a>I would like one feature for every 'e' element, which is simple enough using Feature Paths by setting the elements to match parameter to e on the XML Reader. What I haven't been able to figure out is how to indicate which parent it belongs to. (data1, data2 is b, data3,data4 is c, data5 is d). Adding Ancestor Elements (Parent) in the XML Flatten Options doesn't help because there are no attributes associated with b,d,e. Even if if set the elements to match to a/b/e a/c/e a/d/e explicitly rather than just e, the xml_matched_element is still just e. I can't guarantee the order of the parent nodes, so using the xml_id is not an option either.
Hi,I'm trying to fetch data from the following WFS with a WFS-reader:http://geodata.nationaalgeoregister.nl/bag/wfs?service=wfs&request=GetFeature&typeName=bag:pand&cql_filter=bag:identificatie LIKE '%25158110%25'When I browse it in IE it works fine, but FME throws me the next error:<WFS> An Exception Report was produced performing a `GetCapabilities' request<ows:ExceptionReport xmlns:ows="http://www.opengis.net/ows/1.1" version="2.0.0" xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.opengis.net/ows/1.1 http://geodata.nationaalgeoregister.nl/schemas/ows/1.1.0/owsAll.xsd">Â <ows:Exception exceptionCode="NoApplicableCode">Â Â <ows:ExceptionText>Could not parse CQL filter list.Lexical error at line 1, column 18. Â Encountered: &amp;quot;%&amp;quot; (37), after : &amp;quot;&amp;quot; Parsing : bag:identificatie%20LIKE%20&amp;apos;%158110%&amp;apos;
Good morning!I am using FME 2018 for the process indicated below:Does Safe support or plan to support AFS or Two Factor Authentication for the SharePoint Reader?I have a process where I need to read and manipulate files hosted on SharePoint and move them to another SharePoint site. SO far I am not able to even read the data because of the authentication. Any tips?
Hi, I'm new to pulling data from an API and looking for some advice. So far I have been able to get part of the JSON data I need from an API using the HTTPcaller and using the JSONFragmentor. I have a header and an API key to access the data. My data now looks like this.I now need to grab each location id (location id field is "lid") and pass that value into another URL using the HTTPcaller to extract more detailed data for each location.My end goal is to have the all the data in the above screen cap joined to the additional detailed data that I get from passing the "lid" into the url. Then I can have a point feature for each location "lid" with a complete set of attributes. Any advice would be appreciated. I am just not sure how to pass the "lid" into the URL for each record, then move or loop onto the next record in the dataset.ThanksSherriff
Hi.I'm wondering whether it's safe to set the MS/SQL database that FME works with to single-user while processing it ?I.e., sets the DB to "single-user" before pushing data into it, and to "multi-user" after FME's done.Are there any serious caveats that I should be aware of ?Cheers.
I'm doing a DWG to DWG conversion, but only the top-of-the-sheet header is doubling. I've already used duplicatefilter, but I can not resolve it. This only happens at the top of the sheet ... could anyone help me?Look below: Thank´s
Morning all I am trying to check some DGN files are to a correct standard, i have to check each dgn file has the correct level names, Even if the level names are not used. Is this possible, or does FME only see the DGN Levels (fme_Featue_type) that are used. I have used an excel list that contains all the level names, added the DGN file to check. Hooked these up to a feature merger, that outputs two excel lists. Missing Levels and used levels. however a empty DGN that just contains a line on "Default" level, fails the test, even tho it has all the correct levels set up, Even tho they are not used? I hope this makes sense. Any help would be greatly appreciated. Using FME Workbench 2018.1Reading DGN V8 Files and CSV
I am using FeatureWriter to ouput a text file.It does not put quotes around string attributes like it should.I want"2018-12-07 09:30:00","Canungra (Defence)",0I get2018-12-07 09:30:00,Canungra (Defence),0The third column is numeric and should not have quotes
This is part of another ongoing process. At this point I have 3 DXF file features. #1 = River lines (outlines for eventually a River Area) , #2 AOI for this sheet of data that has now been broken up at each intersecting river line, #3 River centerlines. What I'm attempting to do is select each broken AOI piece that instersects/ touches the river center line and keep only those. The spatial relator or the spatial filter both show that they should work but it is not grabbing all of them. I'm getting roughly 8 out of 11 chopped AOI lines that i need. Everything has been snapped to the AOI to ensure they are close enough together in order to be touching/intersecting (i've used both parameters in the spatialrelator/ spatialfilter tools). In ArcMap you would be able to use the select by location and grab all of these features but I want to do this in fme. Any help would be great. The Red line would be my river centerline and the two blue lines would be the chopped AOI lines i wa
Simple Question:I have a GeoTiff writer. I want the root name name of the GeoTiff to be the same as the root name from a LAS reader. So if the las file is called "cheese.las", the geotiff would end up as "cheese.tif". I tried connecting the las reader to a FilenamePartExtractor, connecting the output of that to my geotiff writer, then setting my "Raster File Name" parameter as the "_rootname" value from that output: Seemed logical - but now I'm getting this error:GEOTIFF writer: Failed to obtain raster from feature. Only features with raster geometry are expected It appears that new connection is sending the geometry of my las point cloud to the geotiff, when all I really need is the name of the thing.What do I do?
Has anybody ever extracted data from DjVu files, using FME?Is it possible at all? Here is a link to a description of the format: DjVu on Wikepedia Any help is appreciated.
Hello, I have the following problem writing SQLite files.I have several use cases where I want to write SQLITE files. For my application, it is important that the virtual tables are also generated in the SQLITE file. If the table name is Table_A, there should also be a virtual table fdo_table_A.I've created some workbench that worked. But I also have workbenchs in which the virtual tables are not created and I do not see the difference. Does anyone know the condition that these virtual tables are created?Many Thanks David