Using readers and writers to extract and load data.
Recently active
I've a file GDB contains Line feature (ways), and Point feature (nodes) and tables for relation contains members and tags. i would like to convert GDB data to osm xml format.I've loaded the tags and members in lists as needed by OSM writer (member{}.type, member{}.role, member{}.ref) and (tag{}.k, tag{}.v) respectively. member listtag listall nodes and ways are written successfully in the .osm output file (xml format) .. all id(s) and ref(s) are correct. the only thing i miss in the xml is part of the relation, as following that output miss the member type=node with role=via and also miss the tag of k=restriction and v=no_right_turn. the expected output should be as following appreciate you help and/or explanation.
I would like to change the name of the folder that is in the datadownload zip to something else than dataset. Is this possible?My flow:I tried giving this option a parameter value from $(exportname). Defined as: When exporting it from the server with data download it gets ignored and only uses the default value.When using the job submitter it does not:It is possible to change the name but it looks like it only accepts the default value and not the incoming parameter that i use in my self made function. I checked at the beginning of the log and the workflow receives the correct value but does not use it with the data download and only uses the default.Is there another way that i can use to manipulate the name of the folder in the zip when using the data download service?
So I'm having a bit of an issue using the fme postgis reader/writer combo. I have a big model that works perfectly using shapefiles (with some adaptations) or using esri gdb. The thing is that I'm trying to only use postgis as entry files and output files. The entry files arepolylines and the output files are polygons. The issue is with the ouput. The input of polylines from postgis seams to affect the ouput.1. Shapefile reader: No problem2. .gdb reader: No problem3. postgis reader: polygons are converted to polylinesA few things to note: 1. When using the postgis reader I can still write the polygons in a shapefile2. When using a shapefile or a gdb as input I can write the polygons in postgis format.The issue to me seems that the spatial column is carried out from the entry data and I don't know how to get it to a blank slate. Sorry for my bad english.
Hello, is there a way (and how) to write block inside a block in AutoCAD Writer? Cheers, Zelimir
I have used excel reader with “Read hyperlinks” option in FME 2018.1.0.0 Build 18520 version. When I have prepared workspace, I used name of the excel file as FileName.xlsx. Later, when I’m running in batch using workspace runner, I have passed FileName_PRAT.xlsx. I have just renamed the file.Surprisingly, I observed that the attributes which are mapped from .hyperlink where dropped and migrated with <Null> values.When I opened workspace individually and checked whether “Read hyperlinks” option is checked or not, it is NOT-CHECKED but when I checked in backup workspace, it is CHECKED. If I passed with another file name even in individual workspace, FME is dropping the Read hyperlinks option. Is it happening for everyone???
I can get the inverts of the pipes in the pipe features, but i need the data to populate with my structure feature and when looking at the format attribute table for structures I don't see those attributes available
i have esri enterprise geodatabase (10.2.2) on mssql server 2012 and want to migrate to postgis(postgreSQL).i get the following error:Bulk copy failed on table 'table name' using delimiter ':' error was ERROR: column has Z dimension but geometry doesnot CONTEXT: can anyone please how i can solve this issue. thanks in advance.
Hello Guys, I am reading a csv file through a CSV Reader and loading the contents in another excel file placed at different location. Finally the source file is supposed to be moved to another location inside the same workbench but i am unable to do so with the help of FileCopy Writer as the CSV reader creates a lock on the file which doesn't allow its moving. It merely copies it without showing any error. Can anybody suggest an another way around?
I have a string af lines in a DXF with two vertices, top and bottom. What I need is an export to excel that shows top and bottom of the line X,Y,Z in order according to location. It's linework of a sheetwall scan. Customer needs an excel spreadsheet with X,Y,Z for top and bottom of the wall. My problem is I need it sorted/relabelled in some way first, as the lines are not drawn in order from end to end. Is there a way to sort, then export the lines in FME? Maybe by placement in x axis direction. I'm new to FME so it's a learning process for me :)
Hi allI´m working with a point cloud with the following schemax|y|gridnum|col0|col1|col2|.....|colN 10|22|121212|12|23|.....|234 10|22|121212|0|12|.....|234 The number of components will vary and I can´t tell a fixed numberAs output I want to remove the 0 values from the col(x) components 10|22|121212||12|.....|234I´m using an iterator to go through all the componentsUsing PointCloudFilter I´m achieving it but only with fixed components. I can also use a user parameter to set component. But again, I cannot update modify. As I cannot use attributes in PointCloudFilter, Is there any way to update the value of the user parameter dynamically within the workspace? I´ve also considered JobSubmitter but I don´t have FME Server....I think that an iterator is needed because I can´t say in advance how many components I will have.Thanks so much in advance
I want to have RGB color out put from Autodesk DWG file. After exposing fme_color attribute the output contains different value. e.g. AutoCAD Color Index(ACI) value 92 and after reading it in FME I get value of (0,0.65,0) . If you look in AutoCAD the value should be (0,165,0)
Yes - another XML question - however - taking the XML below - how do I extract the values just from the 'details_view' - i.e. I want the 'USER' data. I tried the flattening which could work, but I don't know how to differentiate between the two 'views'. <?xml version="1.0" encoding="utf-8" standalone="yes"?><file> <views> <view type="summary_view"> <nodes> <node> <properties> <property type="field_name">DATE_CREATED</property> <property type="field_data" year="2019" month="3" day="12" hour="11" minute="21" second="52" millisecond="938" offsetMinutes="0" normalized="True">2019-03-12T11:21:52.938+00:00</property> </properties> </node> </nodes> </view> <view type="details_view"> <nodes> <node> <properties> &l
Can't find a clear answer on this - is there a way to read from AGOL and write all data including attachments to a local gdb? I found the bit about the dropdown to include attachment and expose as an attribute but this isn't really helping. Does anyone have guidance or a workbench they can send that brings this data through with the actual image or file attachments on the feature itself as it appears in AGOL?Thanks!
Hi, I would like to use a .dgnlib file in the DGNStyler when specifying the 'Cell Library File' but when I do this the translation fails. Does DGNStyler only work with the .cel files for the Cell Libararies? Is there any way to use a .dgnlib instead?Thanks,
Is there a work flow for reading only 1 feature data set in an esri geodatabse reader? I am trying to read only 1 feature dataset, not the entire esri geodatabse so that i can clip the polygons in this particular feature dataset
Good morning all, i am trying to work out how to get the mapinfo (mapinfo_extended, MITAB or MAPINFO) writer to output a .ind file. when writing to mapinfo i get dat, id, map and tab but not ind file. with the MITAB i have made sure that build optimal spatial index is YES but there appers to be no option for any of the mapinfro witters to produce a index file. cheers edit version, fme 2018.1.0.1 build 18528 win 32
Hi, I'm struggling with processing Geodatabase Attachments. My workflow takes polygon features with attachments, test for an attribute and then converts them to points. Pretty simple. However, keeping the attachments isn't working. I know there are other help examples using attachments but I'm not able to get this to work. My workflow and sample data is attached. If someone could please take a look and let me know what I'm missing?
I keep on getting this error: ArcGIS Online Feature Service Writer: Could not find a layer/table matching feature type 'count'What does it mean? How can I resolve it?
Using FME Desktop 2018.1.0.2 build 18547 - Win32 in Citrix environment and trying to upload a folder from enterprise file system to an Amazon S3 bucket. I have a simple creator connected to an S3Uploader transformer and an inspector. When I run the workspace in desktop it rejects the upload and gives an error. I can successfully read from the S3 bucket using S3ObjectLister so I know the credentials are working. Here is the logfile: Even tried running this from a local non-Citrix version of FME 2018.1 same build and get the same error.Also, when trying to upload a single file I get the same error.fme_rejection_code =0 ERROR_INVALID_REQUEST"java.lang.Exception: S3Uploader_<Rejected>: Termination Message: 'S3Uploader output a <Rejected> feature. To continue translation when features are rejected, change 'Workspace Parameters' > Translation > 'Rejected Feature Handling' to 'Continue Translation''Translation FAILED with 4 error(s) a
@mmccart and I have noticed that Esri did something to how ArcGIS Desktop 10.6.1 (aka ArcMap) publishes services to ArcGIS Online. We have tested ArcGIS Pro 10.6.1 and ArcMap 10.5 and both are able to be written to with FME 2018.1 (18547). When trying to write to a service published from ArcMap 10.6.1, we get the following error:ArcGIS Online Feature Service Writer: Could not find a layer/table matching feature type 'LAYER_NAME'
Hello AllI could easily revert to my Python comfort zone but in the spirit of learning can anyone tell me the most FMEic way to extract Total Features, Add, Mods and Del attributes from the attached XML? Many thanks.
I am new to FME (my first post!). So, I am just playing around trying to learn the software a little (we are planning on using it to load a large amount of CAD data into GIS). I am using FME 2018.1 to write (insert) into one versioned feature class within a 10.2 esri SDE in Oracle. Everything looks fine when I look at the version in ArcMap. But I am getting an error at the end of the process.A BADNEWS error shows up in debug logging -- similar to the one in this post :https://knowledge.safe.com/questions/76727/error-running-translation-after-what-appears-to-be.html I am using FME 2018.1 32 bit on win 7 Suggestions?
Hi, I have a dwg file with layer names, is it possible to include this layernames as an attribute in a dgnv7 fiel? It is not possible to keep the layer names as a string in dgnv7, it needs to be a number. So now I try to include it as an attribute. It seams to be possible with tags in the dgnv8 format, but that is not supported in dgnv7. Anyone knows about this? Best/ Johan
I am trying to write to a file geodatabase and I need the strings stored as 8 bit characters. When I write to the gdb they being written as utf-16. I have tried using the attribute encoder to set the encoding to utf-8 but it still get written as utf-16. I am using a feature writer with the DEFAULTS keyword which should store text as utf-8 according to the documentation. Is there a way to enforce that text data be written as UTF8.Thanks