Using readers and writers to extract and load data.
Recently active
I have a lot of building objs with shp and want to convert them to 3dtiles but during converting, because not take coodinates of objs, buildings are overlapped in each tile. How to solve this problem ?
I can add the ArcGIS Feature Service reader to my workspace and see the Layer I want when adding the reader. But when running I get the following message in my log file. |ERROR |Python Exception <HTTPError>: 404 Client Error: Not Found for url:
HiI started to use big volume of OSM data in my work, with requirements of extension that no any available OSM online server page can offer me. For that reason I used OSMDownloader to obtain the data.However I observed a limit of the data volume available to be downloaded. With easy editing of the custom transformer I can skip the limitation of extend, but I still find a limit of the resulting .osm file in 1.048 Mb. I mean that probably there is a limit in the HTTPCaller transformer, or in a time limitation, or maybe in the xml format?Please, some of you could guide me about this limitation?Best Julián
Hello, I’m quite new to FME, so excuse me, if my question is just due to wrong handling of the program. I'm using FME Desktop 2018.0.0.1. So far I wasn't able to find already a similar question that's why I'm trying to ask my question now. I have some problems with a LoD2 Dataset. My plan is to convert it to a .shp using FME Workbench. But as soon as I’m trying to add the data (.gml) to FME Workbench, I’m always receiving these Errors:“XML Parser error: 'Error at file:'' line-0 column:0 message:unable to open file 'http://repository.gdi-de.org/schemas/adv/citygml/moduleApp/1.0/appearanceLoD2.xsd'',“An error occurred while attempting to parse the XML Schema document 'http://repository.gdi-de.org/schemas/adv/citygml/moduleApp/1.0/appearanceLoD2.xsd'”,“The XML Module halted on error, see the logfile for details”,“Failed to obtain any schemas from reader 'GML' from 1 datasets. This may be due to invalid datasets or format accessibilit
File Copy writer is often used in conjunction with Directory and File Pathnames reader to move or copy files from one location to another. Directory and File Pathnames reader returns a list of files in a folder and FileCopy writer will process that list.File Copy Writer allows you to ZIP the entire target folder by simply adding .zip to the folder name on the Destination File Copy Folder parameter, i.e.: D:\\tmp\\filecopy.zipBut what if you want to ZIP each indivdual file that you copy, rather than the entire folder? This is a little burried in the File Copy writer parameters.To ZIP each file that you copy, you can use the Dataset Fanout on the File Copy writer. Fanout expression: @Value(path_filename).zipThis is configured in the Navigation tree under the FILECOPY writer node, Fanout expressionI've attached the workspace for FME 2018
Hello,I got a question about translating DGN V8 to DGN V8. DESIGN WRITER: Found a custom line style linkage with style '-92' which does not match the style name '2.123' in the seed file.But i have a seed file with igds_style_name 2.123 in it.In fact there is more than 30styles in seed_file but only one is not asigned properly (style name '2.123'). Do you have any ideas? Thank youJi?í KalinaPS: .rsc file is prepared like this: http://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/igds/Custom_Line_Styles.htm
Hello. I'm loving the powerpoint writer, nice work safers! I can see alot of potential uses for this, particuarly with making graphics, schematics, charts, etc. It seems like it can only write polygons, not lines - is this correct? Owen
Hi All , i am looking to transfer a json file . our json file is having multiple level of Array. below is the structure of my json fileFrom the above data , I am looking to extract id, long-name and vlan-id.can someone please help me to achieve this .
I am trying to use a soap-xml to get data from a certain site but I do not get the data I want. I tried using a XMLTemplater to create the xml and use this as the response body attribute in the HTTPFetcher with the url_request set to a https://---.com/----.asmx and the HTTP_method set to Post (also tried Get) no result yet. The Get Result xml-template looks like this:Can anybody tell me what I am doing wrong? (I also read the article at https://knowledge.safe.com/articles/45314/working-with-soap-services.html this also has no result)
Hello,please, is it possible to set content of job log similarly to FME workbench. E.g. I want to log only STATS and WARN infomations in log file of FME server... I know how to set these parameters in Workbench, but is there same possibility in FME server please?Thank You so much!Lubo
Hello,I´m trying to find the way to read DGN v7 file settings - - What units are set as master and as sub units? Is there any attribute, which is able to identify these units settings?- Is it possible to detect origin of coordinates of design file? E.g. I have condition that origin of coordinate system of design file have to be set to XXX, YYY.- I read that FME desing file reader v7 doesnt support file attribute igds_element_view_independent, but desing file v8 does. Why? I´m not DGN file expert, but is it caused by the reason that dgn v7 completely doesnt support view dependent parameter?Thank You so much!Lubo
I am fairly new to FME and I need to convert a GEOJSON data link to a file geodatabase. I have not be able to find any help online for where to start.Data link is here: https://data.menlopark.org/resource/vdp2-yzq3.geojsonAny help would be appreciated.Thanks!!
Hi!I am trying to write to a AZURE SQL non-spatial database, but I received the below error for just one of my layers. "Microsoft Azure SQL Database Non-Spatial Writer: Failed to write a feature of type `dbo.door' to the database. Provider error `(-2147217887) Invalid character value for cast specification'. SQL Command `INSERT INTO dbo.[door] ([id], [category], [restriction], [ordinal], [name], [alias], [address_id]) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?)'" I've checked the datatypes to see if they match and they do along with the attributes. Could this be a geometry issue? I do not know what else to check for.Thank you for any assistance!David
I am looking to convert a CAD layer to a point shapfile. Below is the data in inspector the highlighted field are the Value I need to capture in my new Shapefile.
I am trying to connect to an external database using a web call service through the EPA (located here: https://www.waterqualitydata.us/portal), but when I use the link from the web service at the bottom of the page under "Show Web Service Calls", i get this error. I think this has something to do with the fact that the service sends the data pulled in a Zip file, and FME can't get passed that to get to the data? Here is the "logfile" that I get after I try to pull it. The file is an Excel File, but again it is bundled into a Zip file: Starting translation... FME 2017.1.0.0 (20170731 - Build 17539 - WIN32) FME Database Edition (floating) Permanent License. Machine host name is: D22761 Operating System: Microsoft Windows 7 64-bit Service Pack 1 (Build 7601) Copyright (c) 1994 - 2017, Safe Software Inc. Safe Software Inc.Pote
Has anyone got expereince of writing direct to a gmap file?I can write to kml then import into gmaps which then creates the gmap file but wanted to know if I can simply write to gmap and update the layer automatically. ThanksSeb
I read a shp file, and work with the Extruder transformer , after that write to a geojson file, but geojson's geometry type is "MultiLineString", I want to set the geometry type of "MultiPloygon", how to set?
The task is to read a postgis table (fully qualified namespace.tablename) from one database and write it to another database into the same namespace and with the same tablename. Table name and namespace are not known beforehand but get submitted in the form namespace.tablename as a parameter at runtimeI have successfully created this JobSubmitter workspace:which, according to this logfile runs successfully.The server workspace postgis2postgis.fmw looks like this:and when run, fails for reasons unknown to me. The server log is this: I cannot figure what I've misconfigured here, so any help would be greatly appreciated.
Hi there. Using a CSV to drive a process that will copy various featureclasses in various schemas to corresponding schemas in a postgres DB. Using a workspacerunner fed the input connection file, the output connection file, and the schema and tablename. Some variations have almost worked, but invariably none of the attributes transfer over and there are too many attribute columns. Please advise.Thank you.
i have a wms server background map service i use it with data driven page in arcgis to generate a multiple pages PDF file format how can i make it with fme desktop... notice that i have an aggregated shp file ready to be used and i also tried to put the wms server from the background in the inspector because when i put it from the work space it doesn't run well.Thanks
Hi,I have been using the sql executor to run a sql server stored procedure which populates a table, I then try to use a feature reader to read from the table that has just been populated. Alas it times out. If I do either of these components separately it works leading me to believe FME is holding the connection open to sql server and creating a lock on the table, so that when the reader tries to read it can't. I am using the SQL Server JDBC Client. I will try with the Native Client but this will mean I can't use it with fme cloud which is what it is intended for. Has anyone else had this issue? Working log and failing log are attached.Many Thanks as always
hola, queria saber de la manera mas fácil, como restar de dos ficheros lidar los valores de las Z. Realmente es el mismo lidar, lo que uno es solo con la clasificación 2, el otro con todas las clasificaciones. donde el resultado sea que se represente las alturas o elevaciones de los objetos respecto al suelo. he llegado poder hacer la resta de las Z, pero no he podido cambiar el valor de la Z calculada con la que tiene el punto. ¿como puedo cambiar la geometría de la z vieja con la calculada?Hello, I wanted to know in the easiest way, how to subtract from two LIDAR files the values of the Z. It is really the same lidar, what one is only with the classification 2, the other with all the classifications. where the result is that the heights or elevations of the objects are represented with respect to the ground, I have come to be able to do the subtraction of the Z, but I have not been able to change the value of the calculated Z with the one that has the point originally. How can I cha
I'm having some difficulties with writing Welsh characters to a MapInfo Professional file and was wondering whether anybody could help?I'm taking OS MasterMap Topographic data in gml format, in this case specifically looking at the Cartographic Text theme, this is then getting written out to a MapInfo Professional TAB file. The issue is that the Welsh characters are being shown as '?' when the file is then viewed in MapInfo Professional (or QGIS).I've tried using both the MAPINFO and MITAB versions of the writer, the MITAB writer does offer a character encoding option but neither UTF 8 or 16 are in the list of available options. I also tried using an Attribute Encoder but this was pointless as the encoding within the FME process does appear to be UTF, it's the writer that is converting everything to, in this case, Windows Latin1 (the system default I believe).Following a little more research it looks like later versions of MapInfo Professional do support UTF,
I want to set the PostGIS namespace dynamically, derived through a RegExp from the SourceDataset_GENERIC parameter, however all my imports end in the 'public' namespace.
Hi,"Shared FME Folders" is a great way to share setups between 32/64 bit instances, between versions, even between colleagues on a network drive if warranted.It seems that there are much documentation on how to share database connections and coordinate systems using these "shared folders". And I even got the shared "Transformers" working.But how do I add and share a Python based custom format using "shared folders" ? Apparently not by just copying the formats folder into "Formats" !It seems that information about formats need to be stored all over the place, typically under "FME_HOME", which is of course not shared. I've seen format information stored in sub folders "formatsinfo" and "metafile", and the format functions themselves (py/pyc files) need to be in a 3rd place.Are there any comprehensive documentation on how "shared folders" work ? And on whether it can fully accomodate custom forma