Using readers and writers to extract and load data.
Recently active
Hello ,we have more than 300 Geotiff image in a folder we need to pick the right one that fit a polygon we have in shapefile , is there any way we could do that with FMEThanks
Hello,I have a shapefile that consists of roof, walls and ground in a buildings model. Each surface has it's own ID ('UUID_BYGGN') assigned to it together with building part ('MSLINK2'). I have a workspace where I read in all the features and sort the surface based on attribute ('IGDS_LEV_N') which tells if it's a roof, wall or ground. After this I assign the attributes 'gml_id' and 'gml_parent_id' to each surface but something is wrong in the workspace. I get error message: CityGML Writer: Found a cycle. The ids of the elements which created this path were `GML_01861c27-7df2-4021-bd4b-300c3b496991,GML_01861c27-7df2-4021-bd4b-300c3b496991_1,GML_01861c27-7df2-4021-bd4b-300c3b496991'. CityGML Writer: While determining the CityGML element heirarchy (based on the gml_id and gml_parent_id attributes) a cycle was detected. Cyclic features can't be serialized into a CityGML Document. A fatal error has occurred. Check the logfile above f
I have created a custom transformer for clipping using lastools. My input readers are LAS file and the polygon shape file. When I run the translation, the LAS data is read but my polygon reader is not initiated. Hence when running the command line tool, the polygon file is not loaded and I run into an error. I disabled the LAS reader to check if my shapefile reader is working fine. I get the same error this time but because the LAS is not loaded. (Obviously!) The point is that there is nothing wrong with the reader.So, my question is how to ensure that both the readers are read at the same time when I run the translation so the my custom transformer can get both the input files for its command line argument?
how do you keep the original colour of my dxf file when I want to conver it into a 3D pdf or a .obj file?It converts them all in grey.Thanks,
Hi, We are trying to distribute FME Workbench through Microsoft Virtualization and for that we would like to know how FME detects that GPSBabel is installed. In our current setup GPS-like readers and writers and their feature types are correctly placed in the workspace, however, running the workspace fails, telling: FME API version of module 'NULL' matches current internal version (3.8 20160224)Creating reader for format: TomTom POITrying to find a DYNAMIC plugin for reader named `TOMTOM_POI'Loaded module 'TOMTOM_POI' from file 'E:\App-V_5\D52C8804-9F50-4D7B-A695-142DCEFE7A5E\87B5596E-AF57-4FA1-B219-EA631F902A79\Root\VFS\ProgramFilesX64\FME\plugins/GDAL.dll'FME API version of module 'TOMTOM_POI' matches current internal version (3.8 20160224)TOMTOM_POI reader: Opening file 'Z:\Temp\Webfleet\gulocPlStr16.ov2'TOMTOM_POI reader: Could not create process gpsbabel -i tomtom -f Z:\Temp\Webfleet\gulocPlStr16.ov2 -o gpx,gpxver=1.1 -F C:\Users\ex19111\AppData\Local\Temp\13\16688_0TOMTOM_POI re
I converted Autocad dwg to KML but I am having issues with attribute blocks. In KML file text in the block is separated into 3 entities with each one having a placemarker which I want to get rid of and show only plain text with proper attributes. Also I do not want to show kml_xxx for each poliline.CAD file, workflow and KML file attached.Any help would be much appreciated
Hi all, I need to convert a couple of hundred pages in SharePoint to MS Word format. During the conversion process (aspx to docx) I need to perform following steps: 1. Read metadata from the page 2. Read the text from a Content Editor webpart while maintaining text formatting 3. Read the page Version History 4. Create a Word file and add the metadata that was copied from the page 5. Add the formatted text from the Content Editor to the new file 6. Add the version history to the new file It would be interesting to know if anyone has done any of the procedures above. I think that steps 1 and 4 are quite so straightforward and I expect challenges in steps 5 and 6. Best regards, Halil Radogoshi
Hello everyone,I am a bit frustrated and have done this in the past (April of this year actually) and for the life of me cannot get same results.I have an access database with a large table that has multiple columns and one of the columns is "Town" and I need to export Excel sheets by town carrying all the data for that specific town (from all the other columns).Ive tried Fanout and Ive tried in writer to ask it to create via town field. Nothing is working. Its frustrating.I know the answer is simple and I thank you in advance to who ever can jog my memory.Also dont get me started on co-worker whom deleted workbench!Thanks!Savas
Can anyone tell me the best method to use to scrape the following webpagehttps://historicengland.org.uk/listing/the-list/list-entry/1435084I am trying initially to extract the following data:-NameList Entry NumberI have tried using the HTTP Caller linked to a HTML Extractor but i can not get anything extracted.Thanks in advance
Hi,I use the smallworld 4.3 translator to read data from a Smallworld database in FME 2016.1 32bitIn the SWORLDSWAF reader i enter an alternative that I am interested in (Alternative: |design_top|xxxxx|) and set export changes from baseline = Yes and Baseline Alternative= | to read changes from the top. I then expect to only get the changes made in this alternative in the database.When i run the query early in the morning (close in time to a nightly system restart) I get the expected result with changes from the alternative of interest. However during the day I get more and more data that has nothing to do with the alternative. I seems like there is a session created at my first connection attempt whitch is then used as top and all changes in or outside the alternative of interest is considered a change. Powergrid is the software we use for network design and in there I can refresh the session I work in by clicking a button. This function is what I need to access via FME somehow.I have
I have a support case in on this - C131989 - but figured I’d ask here as well. I have an existing workspace that’s been running fine every night for months. All it does is access several tables in an AS/400 DB2 database (via an ODBC connection) and export these to a SQL Server database. This is about as simple as an FME workspace can be i.e. one reader to one writer for several tables, no transformers. I now need to add a new table. When I try to import the feature type from the reader, I get the list of tables, select the one I want, and then get the following error:Opening ODBC 3.x ReaderODBC 3.x Reader: Dataset = GTCOUNTY.HTEDTA. Username = citywork. Password = ************Connecting to database...ODBC 3.x Reader: The DBMS name fetched by ODBC driver is 'DB2/400 SQL'ODBC 3.x Reader: The DBMS version fetched by ODBC driver is '07.01.0015'ODBC 3.x Reader: Database version is '7.1.15'ODBC 3.x Reader: Current schema is 'citywork'ODBC 3.x Reader: Now read
From this Question: ESRI Shape files with UTF-8 encoded field names ?The issue is more serious in FME Cloud (FME Server/Engine on Linux).Most users in Japan use Shapefile datasets with the cp932 (Shift JIS - system encoding in Japanese Windows). However, since FME Cloud always treats attribute names of Shapefile datasets with UTF-8 (system encoding in Linux), all the datasets with Japanese attribute names cannot be processed with FME Cloud. MapInfo (MITAB) seems to have similar issue too.I'm afraid that the problem above might be the tip of the iceberg - i18n issues on Linux FME engine.
Say I have a FILE GDB called Fruit with the following feature datasets (Oranges).say there are not feature rows inside Peel or Slices feature classes. how can I extract the coordinate systemFruitOranges (feature dataset) peel (feature class)slices (feature class)In arcCatalog I can easily right click the feature dataset and go to the XY coordinate system tab to see this.methods I have tried in FMETCPL start up script - (here I extract domains and geometry type, but no COORD systems)populating a single row in FME, than reading trying coordinate extractorpython caller - this will not work if feature dataset is emptyThanks,Doug
Hi! I am writing an FME script to insert records into target table. Before inserting a record, I want to delete the record has the same ID in database, if it exists. I made an FME workspace as screenshot to do run a DELETE T-SQL command for each feature, such that all deletions are performed before any insertion.the translation will terminate if any of the deletion fails.However, I considered the following hypothetical scenarios (in practice I never seen any of them happened, but still possible).The 100th feature fails in the SQLExecutor, such that the translation ends with 99 records deleted from database.All feature passes SQLExecutor, but the first feature failed in the writer, such that the translation ends with all deletions done, but not insertion.Considering the importance of data integrity. Is it possible for me to change the workspace, such that:If any feature fails in SQLExecutor transformer, then rollback all the changes made by the same SQLExecutor?If any feature fails in w
The following workflow of comparing tables (in two separate databases) and updating an existing database (SQL non-spatial) is taking for ever. It has been running for 12 hours now to update the database. In 12 hours only 5424 records are compared. I am expecting about 20,000 records to be updated weekly based on update detector comparison. The change detector transformer is in the workbench since I tried that approach as well but failed. How can I make the workflow run faster?
Hi,Im wondering if there is some "best" format for fme to understand?Lets say I want to write vector to raster, but I would like to keep it as smooth as possible to do. Problem normally comes with symbols and different linestyles. For now I've been doing all this with mapnikrasterizer and it works great.Just there is lot manual work to do before it goes like I want. Ofcourse after its done, there is minimal manual work to do. But once you've done bunch of these, I would like to know if there is something I could skip with my workflow? Like automatic symbol reading from other format? Or smthing else.
I like to write the ouput of a transformer to a new esri file geodatabase using FME 2015. I use the Writer Esri Geodatabase (File Geodb API) and for Parameters a template is asked. I point to a Template.gdbNext is again asked for a gdb but if the fgdb does not exists yet, the same applies for a Dataset. How to import into a new fgdb and new feature class with FME 2015.
I have multiple black and white rasters. I want to mosaic them together and then compress them to make them more manageable. These rasters however are scanned images of historic mapping.This means that I have areas outside the georeferenced bounding box that are white(see image). Most sheets have these white areas, so when I mosaic these sheets together there is overlapping, this leads to part of a sheet being covered by another sheet.As these sheets are georeferenced should the extra white areas not both be forced underneath the sheets they overlap? Is there anyway I can force this to happen?
I was wondering if this is at all possible?
Hi,I have a large workspace; a simple export of gas assets. There are a lot of joins and the workspace is large and not so easy to read without zooming in and out. Views are currently not an option. I want to make the workspace easy for the others who are new to FME to support it too.Question:Is it best practice to keep a large workspace as a whole and use bookmarks to manage zooming in and out. The logic in the workspace is simple so this is my preference and what I’ve mostly done to date.Or is my thinking out of date and would it be better to split the workspace into 4 workspaces of 5 assets each. Or even 20 workspaces, one for each asset, and use a (FME Server) workspace runner to call the workspaces one after another? Maintaining the individual workspaces would be simpler but then you have the added complexity of a workspace runner.Your thoughts are welcome. What is the current best practice?Annette
First, I apologize if this is very basic, but I can't seem to find out how to make this work. Additionally, I'm very new to FME so I'm learning as I'm going. This data is about a bike sharing program.I have two CSVs, one contains the station IDs with Lat / Long, the other contains the trip information. Here are some of the columns (I've removed all the others for this question)Station File: station_id latitude longitude Trip File: trip_id from_station_id to_station_idWhat I would like to go is add them to a (Geo?)JSON file, so each TRIP_ID contains a polyline geometry of the FROM and TO locations. How would I got about doing this?
I need generate a SpatiaLite database that stores a 1:n relationship. The 1 side is a spatial table and the n side is a non spatial table. Firstly I create a template (template.sqlite from template.sql). If I use only the SpatiaLite writer I get an error with the non spatial table (test1.fmw). Maybe I misunderstand the meaning of wkb_none. If I use a SpatialLite writer for the spatial table and a Sqlite for the non spatial table, everything runs ok but it seems that FME ignores an existing constraint in the template database (test2.fmw).Workspaces: Source data: https://goo.gl/5FfJBs
I am noticing WFS reader times that are more than 5 times slower on FME 2017 when compared to FME 2016. A workbench that extracted data in 7 minutes in 2016 is taking over 40 minutes in 2017. In addition there are differences in the log files2017: all of the "HTTP response - so far received: ##.## MB" messages were written to the log before any "Reading Source Feature # xxxx" messages appeared.2016: the read messages start appearing within the "HTTP response - so far received: ##.## MB" messages. 2017: The display count holds at one until all features have been read2016: display counts continuously increase as features are being processed through transformers, while data is still being read in. Are there settings in FME 2017 that can be changed to get it to perform the same way it did in 2016?