Using readers and writers to extract and load data.
Recently active
Hello !Before going deep into this, I would like know : is there a simple way to read a GTFS, then "translate" it into a graph structure, and write the graph into file ? (XML, GraphML, JSON, GraphJSON, other ?) Thanks in advance !
Hi all, I have several PNG-files along with separate georeferenced PGW-files. How can I somehow import those to FME desktop and convert to a format compatible with Google Earth? What I want is to make this map an overlay in Google Earth. I also have the possibility of downloading the maps in in GML (.xml), ESRI shapefile, or Mapinfo MIF/MID. Whatever works best. I just want to import to Google Earth somehow. I'm completely new to map modelling and FME so please give a really simple solution ^^ Thanks, Ruben
Hi, I am trying to create a KML output which extrudes building polgyons and overlays a Flood Map. Unfortunately I cannot get an output with all of the polygons in a uniform color (see attached image), does anyone know how I fix this issue?Thanks,Aaron
Problem:I have a workbench that reads data from a geopackage and writes this to a postgis table. The workbench simply reads data and writes the data with only one attribute. The primary key, called 'fid', should be generated by postgis and not FME so I do not provide a primary key in FME.This postgis table has a column called 'fid' which is the primary and has a not null constraint. It creates the primary by auto incrementing using 'nextval('mytable_fid_seq'::regclass)'. - The workbench used to work, and has stopped working suddenly- other similar workbenches still work on other databasesAn (unwanted) solutionThe only solution that works is to add an SQL Executor before writing the data. However this slows down the progress a lot. The statement is: 'select nextval('treetops_py_fid_seq') as fid'. I'd rather have a different solution.Adding a counter that generates numbers and write these as 'fid' works, until it finds a situa
Hello, anyone having experience writing Trimble JobXML files (.jxl) according to .xsd? Tips, tricks and best practice appreciated?
I have a DWG file with autocad_surfaces.I want to export these to a line, so that I can use it in ArcGIS Pro.How can I convert the features from surfaces to lines in an ArcGIS File Geodatabase using FME 2018?
Can any one explain why FME have recognised the same excel attribute format as x coordinate in FME version 2018
Hello! For an FME Batch process I am working with the Workspace runner. In the two main FME workbenches a conversion from GeoJSON EPSG 4326 to Shapefile EPSG 31256 is made. In the second main workbench there is a conversion in the opposite direction. My question now is the following: In the Workspace that actually runs the two "main" workspaces I am using the Directory and File Pathname Reader. In this reader I defined the folder, where the Input GeoJSON and Shapefiles are stored. (attached you van find a Picture of the Workspace.) This path I connected to the two WorkspaceRunners (1 for GeoJSON and one for the Shapefile Converter. For source (GeoJSON/Shape) I used path_windows). My Problem is that for the process of Shape -> GeoJSON I always get an error '...se_shape_2.shx' lacks the required extension `shp', altough the shx, prj and dbf file belong to the shapefile. Is there ANY way how FME recognizes that these files also belong to the shapefile? Thanks a
For Example:- I am trying to count no of features from multiple feature classes. output is just showing count, however output should be feature class name and then count. Any help is appreciated.
Hi!I want to create a pointcloud in .las based on a .shp file with point geometries. I used the shp-reader -> PointCloudCombiner -> .las writer. The transformer is doing a great job in creating the point cloud but I'm loosing the attribute values when I write the files. In the translation Log you can see: "LAS writer: the following components will be dropped from the point cloud: grid_code, pointid" Why is that? The grid_code has the data typ (float), the pointid (longInt). This link discribes nearly the same problem:https://knowledge.safe.com/questions/53453/how-to-convert-shp-point-geometries-in-to-las-poin.html?childToView=89696#comment-89696 Thanks!!!Sebastian
I've a file GDB contains Line feature (ways), and Point feature (nodes) and tables for relation contains members and tags. i would like to convert GDB data to osm xml format.I've loaded the tags and members in lists as needed by OSM writer (member{}.type, member{}.role, member{}.ref) and (tag{}.k, tag{}.v) respectively. member listtag listall nodes and ways are written successfully in the .osm output file (xml format) .. all id(s) and ref(s) are correct. the only thing i miss in the xml is part of the relation, as following that output miss the member type=node with role=via and also miss the tag of k=restriction and v=no_right_turn. the expected output should be as following appreciate you help and/or explanation.
I would like to change the name of the folder that is in the datadownload zip to something else than dataset. Is this possible?My flow:I tried giving this option a parameter value from $(exportname). Defined as: When exporting it from the server with data download it gets ignored and only uses the default value.When using the job submitter it does not:It is possible to change the name but it looks like it only accepts the default value and not the incoming parameter that i use in my self made function. I checked at the beginning of the log and the workflow receives the correct value but does not use it with the data download and only uses the default.Is there another way that i can use to manipulate the name of the folder in the zip when using the data download service?
So I'm having a bit of an issue using the fme postgis reader/writer combo. I have a big model that works perfectly using shapefiles (with some adaptations) or using esri gdb. The thing is that I'm trying to only use postgis as entry files and output files. The entry files arepolylines and the output files are polygons. The issue is with the ouput. The input of polylines from postgis seams to affect the ouput.1. Shapefile reader: No problem2. .gdb reader: No problem3. postgis reader: polygons are converted to polylinesA few things to note: 1. When using the postgis reader I can still write the polygons in a shapefile2. When using a shapefile or a gdb as input I can write the polygons in postgis format.The issue to me seems that the spatial column is carried out from the entry data and I don't know how to get it to a blank slate. Sorry for my bad english.
Hello, is there a way (and how) to write block inside a block in AutoCAD Writer? Cheers, Zelimir
I have used excel reader with “Read hyperlinks” option in FME 2018.1.0.0 Build 18520 version. When I have prepared workspace, I used name of the excel file as FileName.xlsx. Later, when I’m running in batch using workspace runner, I have passed FileName_PRAT.xlsx. I have just renamed the file.Surprisingly, I observed that the attributes which are mapped from .hyperlink where dropped and migrated with <Null> values.When I opened workspace individually and checked whether “Read hyperlinks” option is checked or not, it is NOT-CHECKED but when I checked in backup workspace, it is CHECKED. If I passed with another file name even in individual workspace, FME is dropping the Read hyperlinks option. Is it happening for everyone???
I can get the inverts of the pipes in the pipe features, but i need the data to populate with my structure feature and when looking at the format attribute table for structures I don't see those attributes available
i have esri enterprise geodatabase (10.2.2) on mssql server 2012 and want to migrate to postgis(postgreSQL).i get the following error:Bulk copy failed on table 'table name' using delimiter ':' error was ERROR: column has Z dimension but geometry doesnot CONTEXT: can anyone please how i can solve this issue. thanks in advance.
Hello Guys, I am reading a csv file through a CSV Reader and loading the contents in another excel file placed at different location. Finally the source file is supposed to be moved to another location inside the same workbench but i am unable to do so with the help of FileCopy Writer as the CSV reader creates a lock on the file which doesn't allow its moving. It merely copies it without showing any error. Can anybody suggest an another way around?
I have a string af lines in a DXF with two vertices, top and bottom. What I need is an export to excel that shows top and bottom of the line X,Y,Z in order according to location. It's linework of a sheetwall scan. Customer needs an excel spreadsheet with X,Y,Z for top and bottom of the wall. My problem is I need it sorted/relabelled in some way first, as the lines are not drawn in order from end to end. Is there a way to sort, then export the lines in FME? Maybe by placement in x axis direction. I'm new to FME so it's a learning process for me :)
Hi allI´m working with a point cloud with the following schemax|y|gridnum|col0|col1|col2|.....|colN 10|22|121212|12|23|.....|234 10|22|121212|0|12|.....|234 The number of components will vary and I can´t tell a fixed numberAs output I want to remove the 0 values from the col(x) components 10|22|121212||12|.....|234I´m using an iterator to go through all the componentsUsing PointCloudFilter I´m achieving it but only with fixed components. I can also use a user parameter to set component. But again, I cannot update modify. As I cannot use attributes in PointCloudFilter, Is there any way to update the value of the user parameter dynamically within the workspace? I´ve also considered JobSubmitter but I don´t have FME Server....I think that an iterator is needed because I can´t say in advance how many components I will have.Thanks so much in advance
I want to have RGB color out put from Autodesk DWG file. After exposing fme_color attribute the output contains different value. e.g. AutoCAD Color Index(ACI) value 92 and after reading it in FME I get value of (0,0.65,0) . If you look in AutoCAD the value should be (0,165,0)
Yes - another XML question - however - taking the XML below - how do I extract the values just from the 'details_view' - i.e. I want the 'USER' data. I tried the flattening which could work, but I don't know how to differentiate between the two 'views'. <?xml version="1.0" encoding="utf-8" standalone="yes"?><file> <views> <view type="summary_view"> <nodes> <node> <properties> <property type="field_name">DATE_CREATED</property> <property type="field_data" year="2019" month="3" day="12" hour="11" minute="21" second="52" millisecond="938" offsetMinutes="0" normalized="True">2019-03-12T11:21:52.938+00:00</property> </properties> </node> </nodes> </view> <view type="details_view"> <nodes> <node> <properties> &l
Can't find a clear answer on this - is there a way to read from AGOL and write all data including attachments to a local gdb? I found the bit about the dropdown to include attachment and expose as an attribute but this isn't really helping. Does anyone have guidance or a workbench they can send that brings this data through with the actual image or file attachments on the feature itself as it appears in AGOL?Thanks!
Hi, I would like to use a .dgnlib file in the DGNStyler when specifying the 'Cell Library File' but when I do this the translation fails. Does DGNStyler only work with the .cel files for the Cell Libararies? Is there any way to use a .dgnlib instead?Thanks,