Using readers and writers to extract and load data.
Recently active
I have some XML data in the structure<a> <b> <e>data1</e> <e>data2</e> </b> <c> <e>data3</e> <e>data4</e> </c> <d> <e>data5</e> </d></a>I would like one feature for every 'e' element, which is simple enough using Feature Paths by setting the elements to match parameter to e on the XML Reader. What I haven't been able to figure out is how to indicate which parent it belongs to. (data1, data2 is b, data3,data4 is c, data5 is d). Adding Ancestor Elements (Parent) in the XML Flatten Options doesn't help because there are no attributes associated with b,d,e. Even if if set the elements to match to a/b/e a/c/e a/d/e explicitly rather than just e, the xml_matched_element is still just e. I can't guarantee the order of the parent nodes, so using the xml_id is not an option either.
Hi,I'm trying to fetch data from the following WFS with a WFS-reader:http://geodata.nationaalgeoregister.nl/bag/wfs?service=wfs&request=GetFeature&typeName=bag:pand&cql_filter=bag:identificatie LIKE '%25158110%25'When I browse it in IE it works fine, but FME throws me the next error:<WFS> An Exception Report was produced performing a `GetCapabilities' request<ows:ExceptionReport xmlns:ows="http://www.opengis.net/ows/1.1" version="2.0.0" xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.opengis.net/ows/1.1 http://geodata.nationaalgeoregister.nl/schemas/ows/1.1.0/owsAll.xsd">Â <ows:Exception exceptionCode="NoApplicableCode">Â Â <ows:ExceptionText>Could not parse CQL filter list.Lexical error at line 1, column 18. Â Encountered: &amp;quot;%&amp;quot; (37), after : &amp;quot;&amp;quot; Parsing : bag:identificatie%20LIKE%20&amp;apos;%158110%&amp;apos;
Good morning!I am using FME 2018 for the process indicated below:Does Safe support or plan to support AFS or Two Factor Authentication for the SharePoint Reader?I have a process where I need to read and manipulate files hosted on SharePoint and move them to another SharePoint site. SO far I am not able to even read the data because of the authentication. Any tips?
Hi, I'm new to pulling data from an API and looking for some advice. So far I have been able to get part of the JSON data I need from an API using the HTTPcaller and using the JSONFragmentor. I have a header and an API key to access the data. My data now looks like this.I now need to grab each location id (location id field is "lid") and pass that value into another URL using the HTTPcaller to extract more detailed data for each location.My end goal is to have the all the data in the above screen cap joined to the additional detailed data that I get from passing the "lid" into the url. Then I can have a point feature for each location "lid" with a complete set of attributes. Any advice would be appreciated. I am just not sure how to pass the "lid" into the URL for each record, then move or loop onto the next record in the dataset.ThanksSherriff
Hi.I'm wondering whether it's safe to set the MS/SQL database that FME works with to single-user while processing it ?I.e., sets the DB to "single-user" before pushing data into it, and to "multi-user" after FME's done.Are there any serious caveats that I should be aware of ?Cheers.
I'm doing a DWG to DWG conversion, but only the top-of-the-sheet header is doubling. I've already used duplicatefilter, but I can not resolve it. This only happens at the top of the sheet ... could anyone help me?Look below: Thank´s
Morning all I am trying to check some DGN files are to a correct standard, i have to check each dgn file has the correct level names, Even if the level names are not used. Is this possible, or does FME only see the DGN Levels (fme_Featue_type) that are used. I have used an excel list that contains all the level names, added the DGN file to check. Hooked these up to a feature merger, that outputs two excel lists. Missing Levels and used levels. however a empty DGN that just contains a line on "Default" level, fails the test, even tho it has all the correct levels set up, Even tho they are not used? I hope this makes sense. Any help would be greatly appreciated. Using FME Workbench 2018.1Reading DGN V8 Files and CSV
I am using FeatureWriter to ouput a text file.It does not put quotes around string attributes like it should.I want"2018-12-07 09:30:00","Canungra (Defence)",0I get2018-12-07 09:30:00,Canungra (Defence),0The third column is numeric and should not have quotes
This is part of another ongoing process. At this point I have 3 DXF file features. #1 = River lines (outlines for eventually a River Area) , #2 AOI for this sheet of data that has now been broken up at each intersecting river line, #3 River centerlines. What I'm attempting to do is select each broken AOI piece that instersects/ touches the river center line and keep only those. The spatial relator or the spatial filter both show that they should work but it is not grabbing all of them. I'm getting roughly 8 out of 11 chopped AOI lines that i need. Everything has been snapped to the AOI to ensure they are close enough together in order to be touching/intersecting (i've used both parameters in the spatialrelator/ spatialfilter tools). In ArcMap you would be able to use the select by location and grab all of these features but I want to do this in fme. Any help would be great. The Red line would be my river centerline and the two blue lines would be the chopped AOI lines i wa
Simple Question:I have a GeoTiff writer. I want the root name name of the GeoTiff to be the same as the root name from a LAS reader. So if the las file is called "cheese.las", the geotiff would end up as "cheese.tif". I tried connecting the las reader to a FilenamePartExtractor, connecting the output of that to my geotiff writer, then setting my "Raster File Name" parameter as the "_rootname" value from that output: Seemed logical - but now I'm getting this error:GEOTIFF writer: Failed to obtain raster from feature. Only features with raster geometry are expected It appears that new connection is sending the geometry of my las point cloud to the geotiff, when all I really need is the name of the thing.What do I do?
Has anybody ever extracted data from DjVu files, using FME?Is it possible at all? Here is a link to a description of the format: DjVu on Wikepedia Any help is appreciated.
Hello, I have the following problem writing SQLite files.I have several use cases where I want to write SQLITE files. For my application, it is important that the virtual tables are also generated in the SQLITE file. If the table name is Table_A, there should also be a virtual table fdo_table_A.I've created some workbench that worked. But I also have workbenchs in which the virtual tables are not created and I do not see the difference. Does anyone know the condition that these virtual tables are created?Many Thanks David
HelloI need to make a join between a geometry (polygon) from a block (DWG File), and the insertion point of this geometry : How can I do this ?Is there a unique common Identifiant betwen insertion point and geometry, for a block object ? I need to do this because I have to put the autocad_entity_handle of the insert point in the geometry (polygon) attribute (because autocad_entity_handle is not a unique ID for the polygon from the block). I used the "Preserve Insert Point" in DWG Reader Options : Thank you.
Hi, I have Vegetation data (tree) as pointZ. I need to convert the data into citygml with 3D representation and also I need to apply tree texture.Kindly let me how to acheive this. I used appearance setter to apply texture but it is not working. Citygml Schema : SolitaryVegetationObject ThanksK.Jayakumar
The issue I am having is the DXF data I have has been split up into "Sheet" level data. This means (in this case rivers) lines have a long distance between them. The snapping setting does not work as I have to use a parameter that is too high and it messes with the data. Is there any way to "close" these openings on the rivers? The first picture is an overview of the "sheet" level data I am talking about with several openings and the second is a zoomed look at one of the large river "openings". The third image shows the line I am attempting to create in order to close these spots off and in turn convert to a polygon. In the end I will be converting the data to shapefile.
Hialthough I can read english quite fluently, for this kind of technical stuff I still feel more confortable doing it in my mother tongue, spanish. I feel I lose nuances that can make my processes more efficient becuase I did not select the right transformer.I have seen that there exist the FME in spanish, but I don't need it. I am OK working in english, it is just sometimes I waste too much time 'deciphering' the help :)I have seen that all the documentation (and you have a lot) is in english. Maybe it is just I did not look in the right place.So, is there any place where I can find the documentation in Spanish?Thank you very much in advanceAitor
Hi, I am new in FME - I need a help. I would like to convert an PDF file to JPEG.
I'm sorry if this has been answered before but I couldn't find the exact answer to my question which is:How do I change the output name of an excel sheet (or file) based on a specific attribute name. Example: I need my output sheet name to be "Namn" and automatically read from the attribute name since I have multiple similar datasets but with variations on "Namn". All of which should be put into a separeate sheet but in the same file.It is probably really simple but as I said, I couldn't find it.(For me the output parameters and schemas are real confusing)
I have a workspace that I am attaching here . Its function is to cut the trails using the first network limit, now besides making this cut, I also need to cut the trails using park, but always creating polygons with the remaining cut parts. P.S. all input file are DWG In this workspace if I use only network works perfectly (see image), but if I enter the park layer, the following error below appears: INDEX FAILURE - requested predicate not implemented Why does it happen? Can you help me? Thank´s
I have a DWG file and in a layer has a field in autocad_text_string that has a date. But in all 1000 records this field only appears 1 time obviously ... how do I make this date repeat for all other 999 features? considering that I will read a whole folder with several DWG files, how do I make each one have its own date? Thank´s
I have exported data from PDF file using FME. The output contains lines, polygon and text data. A sample of the text data is attached. I need to combine the different letters in points with the same TEXT_ANGLE and TEXT_SIZE to form a new attribute containing the full text and write it to 1 point feature.
I have a workbench that uses the SurfaceModeller transformer to produce a DEM (DEMRaster output port) from input polylineZ and break lines inputs. The output DEMRaster will be used as an input in various raster math operations with an existing terrain DEM. It is thus crucial that the DEMRaster output match the cellsize and be perfectly aligned to the existing terrain DEM. In Esri parlance this can be achieved using the "Snap Raster (Environment setting)". How can I achieve this with FME? I am using FME Desktop Professional 2017.1.1.1. I have tried using the RasterGeoreferencer as recommended in the Snapping raster output cells to existing raster template cells (same cell size) post. I can either control the extents (using the "Extents" parameter) or the cell spacing (using the "PointAndAngle") but I can't figure out how to control both. Thanks!
Good morning, I'm trying to extract a table from a website, but am having a difficult time doing so. The issue is that the website has a pull down option with multiple tables. I'm able to use HTML Table reader to extract the table that comes up as a default, but I need to pull one of the other tables. The URL that I'm using is https://eds.ospi.k12.wa.us/DirectoryEDS.aspx. In upper left, you have the option to select Reports by either District or School. District comes up as the default; but I am actually interested in the school table. Can someone help me achieve this? Using the HTML Reader, I'm able to see the default table that comes up on the website which is gvESDDirectory. However, the table that I'm looking for is called gvSchoolDirectory. I can see it using developer tools in Chrome. I'm just not able to figure out how to get FME to see that table. Thanks!Eugene D.
I want to read a csv from a URL, but I am failing to connect.I add a ReaderFormat: CSV (Comma Separated Value)Dataset: http://www.bom.gov.au/fwo/IDQ60801/IDQ60801.94418.axfunder ParametersDelimiter Character: ,Field Names Line: 20Data Start Line: 21 but I get the errorCSV reader: Failed to open file 'http://www.bom.gov.au/fwo/IDQ60801/IDQ60801.94418.axf' for reading. Please ensure that the file exists and you have sufficient privileges to read itWhen I use chrome to visit the URL I succeed. The URL and resulting csv file definitely exist.What I want is to read (and process) the csv file using FME
I have tried multiple combinations, but it seems the "Max Features to Read Per Feature Type" value is being ignored. I have 14 Feature Classes selected in my "FEATURE_TYPES" Published Parameter, so hence, if I set the value to 2, it should read 28 records but unfortunately it seems to only read 2 records from a random Feature Class. I am using v2016.1.0.1Refer @mhab's comments in this idea post: https://knowledge.safe.com/idea/25361/add-a-max-feature-to-read-per-feature-type-paramet.html