Using readers and writers to extract and load data.
Recently active
Hi, I am trying to automate a process whereby I download data from my sql server enterprise geodatabase in both spatial and non-spatial format. Currently I have implemented one fme workbench (.fmw) which belongs one ESRI (ArcSDE) reader , which contains all the spatial and non-spatial table list as input parameter, along with I have following published parameters for input: a. Dest_Format (GML, KML, Shape, ESRI-JSON, SQLite, CSV)b. DEST_COORDSYS: DHDN, WGS, Tranverse, ...)c. Email Adress:(for sending the data download link)I am strugling currently with downloading as csv format, and it is creating csv file without column names, and storing also the fme_feature_type information. All the tables downloaded as spatial format is working well. Pelase give me a way thus I can download the csv and other non-spatial format perfectly.Can anyone help me? @takashi Many many thanks.
When im trying to transform citygml data to ogckml, the FME data inspector does not view the data correctly in 3d view. Instead of separate individual 3D buildings, the data is just a long thin "stick". Data looks correct when viewing with google earth and with FME data inspector in 2D view. Why is this happening?Also when trying to convert that kml to wavefront object, the object file comes out as a long stick also.It seems like every kml file containing 3D data is showing up as along thin stick in fme data inspector when viewed in 3d
In every red point I'm trying to create a line, parallel to the blue line. So far I used a linebuilder to create a profile line. Then I created a point at the intersection of the blue line and profile line. Next I would like to know the direction of the blue line at the intersection point. Anyone tips?
INSPIRE GML WriterFME Desktop 2017 1.2.1 build 17725 Sample: GovernmentalServices.xsd > ContactType in BaseTypes2.xsdAre the attributes of feature types that refer to other xsd-files by <element ref =”…”> not resolved as user attributes? For example: GovernmentalService.xsd with <element ref = "base2: Contact" /> on schema BaseTypes2.xsd. The attributes of the ContactType are missing as writer user parameters.
My workflow requires reading .zip files, containing multiple XML’s containing the data I require.The .zip file name is a concatenation of the following information:VariableProcessname1_VariableProcessname2_TransactionID_Date_Variable.zipAt this stage I have only been successful reading in multiple files using the direct file path followed by *.zip to reference all files. However the folders which store the .zip files have thousands of items, and for this particular process I need to only use the .zip files which are of a set date range – ie. the last two days. I have tried (unsuccessfully) the following methods to read the files I need:1. Use the StringConcatenator transformer to create an attribute to insert in file path. I get the following error. 2. Create a user parameter, however again I have only been successful using wildcard as the file name. I am thinking some python code (possibly in conjunction with a file path reader) may be the best solution? If someone is able to provid
I cant open a Version 3 ECW in FME Data Viewer. Error comes up and says I need new version of ECW SDK. I am using Desktop 2016 , and have downloaded the new SDK Version 5.1 from Intergraph. How do I leverage this in FME?
In Oracle, you can assign a default tablespace to an owner (schema). We are moving all our spatial databases to PostGIS where a schema cannot have a default tablespace. Instead you have to specify the tablespace to use with the create table syntax.With FME desktop, how can I specify what tablespace I want all these cloned tables to go into without first somehow creating empty tables myself and then appending to them?
Hi there,I currently use FME to mantain open datasets which are hosted on a Socrata-based platform, utilising FME's Socrata Writer. One of the limitations I've found with this Writer is that it only supports tabular data. I'd like to automate the update of our spatial data, which are published as shapefiles in a compressed .zip format. Are there any pre-existing Workbenches which interact with the Socrata API in such a way that I can automate the upload-replace process with these shapefiles? I believe that Socrata has developed their own DataSync Java application which performs this action, but if I can automate this process within FME it would be preferred.Many thanks!
Hello, I am trying to extract the attributes from Excel to Shape file. I have a large shape with certain attributes, and I would like to join them by some conditions. For example in this case, there are two attributes that are same as the names of the cells in Excel. If those values are the same, I would like to join the rest of attributes. I am trying to do this with feature merger. Xls is supplier and Shape is Requestor in my case, but I am not getting those extra attributes that I want to get. Can somebody please help me with a hint? Best regards, Dejan
I keep getting this when trying to write to an ESRI FGDB: "Unable to remove existing dataset at location `.......' for writer `GEODATABASE_FILE_1'.Any suggestions?
Hello everybody,I have a building in 2d and i use a 3dforcer to create an 3d building (walls collums doors rooms...) but i want to write it to postgis. when i use the datainspector to look at the postgis data i can't see anythingHow can i store the 3d object in postgis?
I am running FME 2018 and attempting to convert a Geotiff into a format that I can load onto my S3 bucket and read using the ArcGIS javascript API. some of the formats in FME i tried to convert to failed with no success. ESRI 3D indexed Layer and cesium 3D tiles.any suggestions? thank you
Hi, I'm looking to set up a FME workbench which will take multiple .dwg files in a specific folder and convert them to individual pdf's. This won't be a one-off process with the idea being to be able to add new .dwg files to the folder and to convert them to pdf as and when required. Can anyone suggest the best way of doing this please? many thanks
I need to update an arcmap sde feature but just one column. I use feature merger to join the data I am planning to use to update the SDE. However, I have found featuremerger to be really hit and miss, often it won't join all the features that should be.The main issue I am having is after feature merger there are 17 features that are joined. I then want to update my SDE (which was also the input) based on the join. It runs successfully but won't update my fields.The workflow looks like thisReader A Reader B featuremerger Attribute manager Writer I need an attribute from reader b to update the writer which is the same feature as reader A
We use a PostgreSQL connection to access our GreenPlum environment to execute a SQL statement to pull non-spatial point data. Normal Query runtime, runs fine.When the tables involved in the SQL are under heavy load, the query slows down a lot. It then NEVER returns anything and will continue to run until we stop it.So, my question is. When we setup connections in FME desktop, is there any way to setup a MAX connection timeout or Query timeout?
I have a lot of building objs with shp and want to convert them to 3dtiles but during converting, because not take coodinates of objs, buildings are overlapped in each tile. How to solve this problem ?
I can add the ArcGIS Feature Service reader to my workspace and see the Layer I want when adding the reader. But when running I get the following message in my log file. |ERROR |Python Exception <HTTPError>: 404 Client Error: Not Found for url:
HiI started to use big volume of OSM data in my work, with requirements of extension that no any available OSM online server page can offer me. For that reason I used OSMDownloader to obtain the data.However I observed a limit of the data volume available to be downloaded. With easy editing of the custom transformer I can skip the limitation of extend, but I still find a limit of the resulting .osm file in 1.048 Mb. I mean that probably there is a limit in the HTTPCaller transformer, or in a time limitation, or maybe in the xml format?Please, some of you could guide me about this limitation?Best Julián
Hello, I’m quite new to FME, so excuse me, if my question is just due to wrong handling of the program. I'm using FME Desktop 2018.0.0.1. So far I wasn't able to find already a similar question that's why I'm trying to ask my question now. I have some problems with a LoD2 Dataset. My plan is to convert it to a .shp using FME Workbench. But as soon as I’m trying to add the data (.gml) to FME Workbench, I’m always receiving these Errors:“XML Parser error: 'Error at file:'' line-0 column:0 message:unable to open file 'http://repository.gdi-de.org/schemas/adv/citygml/moduleApp/1.0/appearanceLoD2.xsd'',“An error occurred while attempting to parse the XML Schema document 'http://repository.gdi-de.org/schemas/adv/citygml/moduleApp/1.0/appearanceLoD2.xsd'”,“The XML Module halted on error, see the logfile for details”,“Failed to obtain any schemas from reader 'GML' from 1 datasets. This may be due to invalid datasets or format accessibilit
File Copy writer is often used in conjunction with Directory and File Pathnames reader to move or copy files from one location to another. Directory and File Pathnames reader returns a list of files in a folder and FileCopy writer will process that list.File Copy Writer allows you to ZIP the entire target folder by simply adding .zip to the folder name on the Destination File Copy Folder parameter, i.e.: D:\\tmp\\filecopy.zipBut what if you want to ZIP each indivdual file that you copy, rather than the entire folder? This is a little burried in the File Copy writer parameters.To ZIP each file that you copy, you can use the Dataset Fanout on the File Copy writer. Fanout expression: @Value(path_filename).zipThis is configured in the Navigation tree under the FILECOPY writer node, Fanout expressionI've attached the workspace for FME 2018
Hello,I got a question about translating DGN V8 to DGN V8. DESIGN WRITER: Found a custom line style linkage with style '-92' which does not match the style name '2.123' in the seed file.But i have a seed file with igds_style_name 2.123 in it.In fact there is more than 30styles in seed_file but only one is not asigned properly (style name '2.123'). Do you have any ideas? Thank youJi?í KalinaPS: .rsc file is prepared like this: http://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/igds/Custom_Line_Styles.htm
Hello. I'm loving the powerpoint writer, nice work safers! I can see alot of potential uses for this, particuarly with making graphics, schematics, charts, etc. It seems like it can only write polygons, not lines - is this correct? Owen
Hi All , i am looking to transfer a json file . our json file is having multiple level of Array. below is the structure of my json fileFrom the above data , I am looking to extract id, long-name and vlan-id.can someone please help me to achieve this .
I am trying to use a soap-xml to get data from a certain site but I do not get the data I want. I tried using a XMLTemplater to create the xml and use this as the response body attribute in the HTTPFetcher with the url_request set to a https://---.com/----.asmx and the HTTP_method set to Post (also tried Get) no result yet. The Get Result xml-template looks like this:Can anybody tell me what I am doing wrong? (I also read the article at https://knowledge.safe.com/articles/45314/working-with-soap-services.html this also has no result)
Hello,please, is it possible to set content of job log similarly to FME workbench. E.g. I want to log only STATS and WARN infomations in log file of FME server... I know how to set these parameters in Workbench, but is there same possibility in FME server please?Thank You so much!Lubo