Using readers and writers to extract and load data.
Recently active
I need to transform a big ECW (30GB) into a GeoPackage. I think I do not need any kind of processing of the data, so the workspace is pretty simple: That works fine with small rasters, but the big one is draining all my computer resources (being honest, those are not that great...). The obvious solution is executing this workspace in a better computer with enough RAM, but I wanted to try something else.I have created a "parent" workspace that builds a grid. Then, I call the "child" workspace and clip the ECW with a cell of that grid using the Search Envelope parameters of the ECW Reader. If the Tile Set Name of the GeoPackage Writer is a static value, the result only contains the data of the last cell of the grid. The data is overwritten even though I have made sure the checkbox for Overwrite Database is unchecked:I guess, that check is not for what I thought.If I use a dynamic Tile Set Name for the GeoPackage Writer, all the data is stored; but each cell in differe
Is there a way to use both parameter options with a DWG, i.e. Read Model Space Entities Through Viewport - Yes and Read Model Space Entities Through Viewport - No?I have some features, like text, that need to be tested for text height and thus need the 'Read Model Space Entities Through Viewport' set to 'Yes' as this will give me the paperspace size for the entities.If I have the 'Read Model Space Entities Through Viewport' set to 'No', I can test the features that are only in either paperspace or model space but can get the paperspace text size for through features displayed through a viewport. Any suggestions on how I can determine what is only in model space and only in paperspace but get the paperspace size for all features?
A Rest query resulted to a JSON result which includes a URL to another JSON file from the host server. I want to download that JSON URL so I can save it on my computer and then read it as well.For some reason just passing the URL from the JSON flattener and configuring the dataset of the FeatureReader with Format: JSON with that url attribute is not working.It would be good to just implement this with FME Server as a download service but right now I'm limited to Desktop. At the very least I want to read the JSON from the server and it's also not working either.I tried File Copy Writer by parsing the json filename on the URL and it did not work either.
Hi, I am trying to figure out how to write into AutoCAD Civil 3D Pipe Network from a esri file geodatabase?The main reason is that we store all utility data (material, diameter, install date, disposal date, asbuilt) in the File Geodatabases, but would like to pass that data directly to the engineers who work in AutoCAD.I have read sample Civil 3D pipe networks from the engineers to try to figure out how the data is set up, but I am still unsure of how to write the GIS data out so that the engineers have all the extra attributes.Thanks!
I have been working on a proof of concept to take an Esri XML Workspace Document (exported from Esri), and have a user run a workbench on FME Cloud to convert it into a HTML report.I finished creating the workbench locally (FME Desktop with ArcGIS 10.6 installed) using the Esri Geodatabase (XML Workspace Document) reader and went to publish to FME Cloud and discovered it won't run since ArcGIS isn't installed on the machine:Module 'GEODATABASE_XML' is unavailable for use with this FME editionI looked around and found this article which explains why: https://knowledge.safe.com/questions/43509/how-should-we-add-esri-support-on-fme-cloud.html. My question is this - can I use the generic XML reader instead to read in an Esri XML Workspace Document? If so, where do I start?Example of XML: This is what it looks like with the Esri Geodatabase (XML Workspace Document) reader:
Hello. I'm using FME Desktop 2019.Basically I have a Postgis table where the column names are in lowercase and I want to write to an ArcSDE Geodb table but I want to have only the column names changed from lowercase to uppercase when writing to the ArcSDE table. Only the column names, not the record attributes. I want to leave the record attributes the same.I've tried using the BulkAttributeRenamer but this will change the column names to uppercase but then it messes up the type and width of the column (fields).Any guidance would be much appreciated.Thank you.
Hi I found that FME converts IFC Relations to some attributes such as ifc_is_containd_in and ifc_decomposed_by but for me these attributes don't have any value. I've selected these attributes in Format Attributes but still there is no value. Also, I tried GeometryPropertyExtractor and AttributeExposer but nothing changed. Is there any way to extract IFC Relations in FME?Thank you in advance.
Hi, I used to read my ESRI database with the ArcSDE Legacy Reader which worked fine. When I switched to the new GEODATABASE_SDE reader, my ESRI lines that have a cross over that looks like an arc are now read as an IFMEPatch which is a combination of an IFMELine and an IFMEArc. With the Leagacy reader the same line is read as a Line and not as a path of a line and an arc. Is there a way to force it to be read as a line as before? If not possible what would be the best way to convert it as a line? Thanks,Simon
If I use the DWG Reader setting 'Read Model Space Entities Through Viewport' set to Yes, is there a way to determine which features are being read through the viewport?I need to be able to test all features in the DWG but want to test features only based on where they originate from i.e. model space or paper space.
Hello, I am working on converting GIS data to a CAD standard. I have a template file, but the template file has root information (e.g. pipe, manhole layers) but I need to also include status information in the layer name (e.g. pipe-new, pipe-existing layers). I cannot seem to be able to create the new layers with the information from the template layers. I have a spreadsheet that has the name of the layer, the color, linetype, and description. I would like to be able to set the writer to use this information when generating the dynamic layer (e.g. pipe-new). Here are the things I have tried to resolve this:Used DWG Styler - This might work, but it doesn't allow for description and it also doesn't use acad index colors as inputsautocad_color attribute - This attribute is feature specific and does not apply to the full layer. It does make the output look right visually, but it does not follow the layer standard.I appreciate any suggestions you might have on how to do this.
Hey there,I'm new to FME, sorry if it is a newbie question. My pipeline result is the following:I would like to create a text file with the following structure grouped by Template_Prefix and Template_AttributeList::Template=$CM_FT_IndexBi :TagName, Area, DailyInstantVolume.Direct.PV.InputSource, ......etc <content of line#1 column "Value" here> <content of line#2 column "Value" here> <content of line#3 column "Value" here> :Template=$CM_G_VV :TagName, ActiveEnergy.PV.InputSource, Area, Description......etc <content of line#4 column "Value" here> <content of line#5 column "Value" here> <content of line#6 column "Value" here> <content of line#7 column "Value" here> :Template=$CM_PT ....etc...How would you approach it ?Thank you for your help !Best regards,Oli
Heyhey and happy new year, Im fascinated with the 3D PDF possibility of FME and am constantly making some needlessly-over-complicated things in it (of course)Up to now I have mainly just been taking either stuff straight out of Revit for buildings/structures to a 3D PDF or draping TIN's with areal photography or other rasters to make nice 3D landscape.Now I want to include vector data in my landscapes, for example not only drape a TIN with areal photography but also drape it with contours (lines) and areas (polygons) and even perhaps somekind of a structure (based on a point).Ive googled around and tried many things but I just have not succeeded, so could anyone suggest a workflow where I:-Introduce vector data (point. line, polygon)-Set the symboligy of that vector data (color, thickness, opacity...)-Drape a TIN with that symbolized vector data (Use the 'Appearance setter'?)-Export that to a 3D PDF (remembering that I already know how to make it with Raster and TIN, just n
When I try to add data to a timestamptz field in postgres using the postgres writer it gives the following error:Value of attribute 'start_date' could not be converted to type 'timestamptz'. Feature will be logged and skippedWARN Â |+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++WARN Â |Feature Type: `admin.real_right_version'WARN Â |Attribute(string) Â : `start_date' has value `2018-11-13 09:43:58.3875761+01'I'm using FME 2018.1 and postgressql 10.5
Is it possible to combine these glob patterns in one PathReader?*.jpg*scheme*.pdf
Is there a way in FME to provide directly the url <server>/<service>/<layerID> ? It takes quite some time at runtime for the reader to get to the service, loop for layers to find the one by providing the name. I'm trying to cut down the execution time and looking for the options of providing directly the url including the layer id, purely for reading purposes.All above while providing the token instead of user/pwd authentication.Any ideas ? Thank you
Hello :) I'm new to FME and I have a question which I didn't found answered yet in your discussion board: I want to read my gpx files and write them into a esri shp file. The gpx files are containing gpxx extensions (heartrate "hr" and a temperature "atemp") but those I cant read. The normal gpx stuff is transferred to the shp file. I will give you a short code snippet from one of my gpx files. Can anyone try to help me ?! Thank you :D These are the first 32 lines: <?xml version="1.0" encoding="UTF-8" standalone="no"?><gpx xmlns="http://www.topografix.com/GPX/1/1" creator="GPS-Track-Analyse.NET 6.0.0.4" version="1.1" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.topografix.com/GPX/1/1 http://www.topografix.com/GPX/1/1/gpx.xsd" xmlns:gpxx="http://www.gps-freeware.de/xmlschema/TrackPointExtension/v1"><metadata>&l
I got files with the type .mon ,I try to use them in the workbench but i cant find a specific format that works correctly with it. The type that should be the closest to it cant read it at all and gives the error as shown in the pictureI also tried it as an CSV because it is a kind of table, but the output is incorrect. Does anyone know how to work with this type of file?
Hi all, I have many .gml files.And, i would like to merge all gml files to one file. But i didn't have any idea on FME. Could you help me with this issue ? Best Regards.
Is there any good open source (or preferrably free) tool to validate any IFC-file? Thanks! Tried the first few pages of googling but with less luck.
Hi, I have an excel table with over 100 folder, lets say for example folder C:\\data\\1a\\z C:\\data\\1b\\z C:\\data\\2a\\z C:\\data\\2b\\z that I read in my main.fmw workspaceand I want to send it to another workspace that is named edit.fmw for example. In each folder I know there is many dwg, but I want to open the one in the subfolder that ends with ....03.dwg because that is always the terrain file in all folders.I want to1. Read excel2. Find the name of the dwg in each folder3. Send it to my other workspace and open it with a reader to do other stuff with. Any ideas?I basically need help with how to set up the workspacerunner and since I dont want to manually find and enter the name of the correct dwg is there a way to test/search for a file in that folder that ends with a specific string? I have looked at pathreader but that only reads dwg--> find metadatafiles and filepath but I want the other way around, folder-->list of all files.
I have been using a workflow that was previously posted here to try and extract text, representing a table, from a PDF and write out a worksheet (for each table) to excel. I have been able to extract and isolate the desired text but I cannot figure out how to properly organize the records to write to the excel cells.
I am really new to FME & spatial data. Is it possible to incrementally pull data from a data center hosted GE Small World database, via FME Cloud & push it to a destination on Azure. Pls share some inputs.
I would like to know if it is possible to import OS Mastermap Topography layers in GML, clip an area of interest and then export that in exactly the same format as the input?
For example, Because the ArcGis Portal publishing maybe failed because too many sub-layers. ( the writer will upload a GDB then publish it in the portal)so to save the time for the publishing waiting time,in a FMW, I want to create a process to create a FileGDB with multiple tables in it by difference process; just after the FileGDB created(100% finished), link this new FileGDB to a ArcGIS portal writer to publish it.But currently the FileGDB writer can't add any process behind it. it is a dead end.Anyway to do this?
Hi there, I've a problem with AIXM data. I try to translate AIXM data to gkpg (he problem is the same with another writer format : shp, postgis...). It only works when I translate AIXM to gml ............Some attributes are missing like the information regarding the volume information for the Airspaces (upper/lower limit....).What is the setting to get all the attributesCan someone help me please ?