Using readers and writers to extract and load data.
Recently active
I would find it helpful if it's possible in FME Desktop to search for a line that has id in my map (shape file ) ,if find it .so check the data and do something if not so do something else .could i ask ,which type of transformer could i use for search in the map for data but iam not sure if my map will has this data or not ,just for check .
Hello to the whole FME community! I have a very simple and basic question to ask you.I work with large volumes of hydrographic data, address data, etc. and soon lidar data.With each treatment / test I perform, my files often duplicate and it becomes easy to get lost in this mountain of data. So I would like to have your opinion on the advantages that I would have to use a database management system (PostgreSQL with the PostGIS extension) For now, I think that this would allow me to: - better manage the storage and versions of my files- optimize the transitions between my files and FME (by directly connecting my DB in FME)- increase the speed of loading and writing my data- get my data instantly in QGIS (by also connecting my DB in QGIS)- to decrease the storage space of my files given that they will no longer be stored in shapefile (+ dbf + shx)? Tell me if I'm wrong, and if you have other advantages to list me, I'm interested! :) Thank you !
Hello, i'm pretty sure it's a simple problem, but somehow i'm not able to write a 3D shapefile. Every time I look at the feature information in the Data Inspector, I get "2D" as the dimension. But I need "3D" as dimension. As a test, I have written the script below. After I have created a "test point", I create an attribute with a height, which I write into the Z-value using the 3DForcer. When exporting I want to write a 3D shapefile, but I have some kind of error and I can't see the forest in front of the trees anymore. Thanks a lot for the help
Hi! I'm using FME 2019.1 with INSPIRE Solution Pack and I'm trying to write an INSPIRE Administrative Unit GML from a shapefile (SHP) that contains some multipolygons. The problem is that the resulting GML does not contain the multipolygons geometries (but the features).SHP (reader) GML (writer) To assign values to the GML fields related to GeographicalName, I use 2 aggregators: one to generate the list "GeographicalName.spelling" and another to generate the list "name", both of them grouping by UUID.However, when doing the same (from the same SHP and using the same transformers) to write an INSPIRE Geographical Names GML, multipolygons are included.Is there maybe any issue with the INSPIRE Administrative Unit GML schema?Comparing the resulting GMLs, Administrative Unit vs. Geographical Names, I see that the first one does not have a MultiGeometry tag.Thank you so much,
I am reading from oracle spatial table and writing to Mongodb. once I written to mongo with some sample data, and i want to re run my fme script again for whole, by drop and create method(mongo db collection). I set the writer option to "drop and create", but its giving error. error msg saying thatMONGODB writer: Layer layerDataPolygon already exists, CreateLayer failed. Use the layer creation option OVERWRITE=YES to replace it.(red color)where to set OVERWRITE=YES(layer creation option) ? as per fme's error msgCan anyone pls help?
Since upgrading to FME Desktop 2019.2.2.0, when I run FME workbenches with excel readers I get the warning:"Excel Reader: Sheet 'mysheetname' has invalid value '' for parameter 'xlsx_start_row'. Parameter will be ignored""Excel Reader: Sheet 'mysheetname' has invalid value '' for parameter 'xlsx_end_row'. Parameter will be ignored" I never got this before, previously i was running 2019.1.3.1. What does it mean and is it a problem?
ok. so there have been a lot of questions about running a workspace through the task scheduler (and the fact that it doesn't work) with running it manually.I have tried all the solutions suggested.Problem:I have a workspace that logs onto an AGOL account, retrieve the data and create an excel.I have no problem running this workspace manually when I am logged on to the server.The issue is when I schedule this to run using a service account. I get this error:ArcGIS Online Feature Service Reader: Connection 'Esri ArcGIS Online' does not exist. Check connection parameter and connection definitions in FME options and try again Solutions I've tried:(moving the data and publick key into a public location) https://knowledge.safe.com/articles/34678/making-database-and-web-connections-public.html(editing the registry) https://knowledge.safe.com/articles/32356/scheduling-software-doesnt-recognize-fme-connectio.htmlset the task to run with highest privilegesset the "Start in&q
Hi,I don't know much about FME, but there is no ESRI support for S57 Data to get a GDB without getting more expensive Tools. So I found a model of FME Workbench from rylanatsafe (https://knowledge.safe.com/articles/570/s-57-enc-hydrographic-data-format.html)But when I run that model,I get the Error:"Could not create a GEODATABASE_MDB writer. Personal geodatabases are not supported with 64-bit versions of FME and ArcGIS. Plugin 'GEODATABASE_MDB' was loaded, but a writer could not be created. Error was #1: A fatal error has occurred. Check the logfile above for details"Is there any way out? So I need the s57 Data as a GDB with the symbologie of s57 data. (ENC) Thanks for attention.
It is only possible to rotate text (fme_rotation; or set idgs_rotation to 0) if the text is splited (split multi text - reader parameter).If the text is splited, there are additional point and line features (with length 0) in the output drawing (looks like the insertion point of the text; see attached picture).Is there a way to rotate the text without the additional objects.
Is there a way to 'IGNORE_UCS' when reading in dgn files? I have heaps of dgns with different user set coordinates systems. The dwg reader has this option but I can't see a way to replicate this setting for dgns.Just to clarify - the dgn are in UTM but each dgn file has a localized UCS set by the designer.
Hi, I have a column named DateTime in a table. The format of date and time is as follows: 9/9/2009 21:23:31 25/12/1991 8:3:23 means There is a space b/w date and time. Date Month Year is seperated by '/' and time by ':' Now, I need to seperate date and time. I want two new attributes Date and Time with respected outputs. Thanks in advance.
Hi Fme:ers, I have a problem inserting data into PostGIS with FME2013. Sometimes it fails after 500 000 objects and sometimes it occur after 5 000 000 objects. Feels like a server/network problem but cant figure it out. Anyone experienced this? 2013-03-01 14:51:07| 102.1| 0.3|ERROR |Bulk copy failed on table 'public.Infra_import' using delimiter ':'. Error was 'server closed the connection unexpectedly This probably means the server terminated abnormally before or while processing the request. ' 2013-03-01 14:51:07| 102.1| 0.0|ERROR |A fatal error has occurred. Check the logfile above for details 2013-03-01 14:51:07| 102.1| 0.0|ERROR |A fatal error has occurred. Check the logfile above for details 2013-03-01 14:51:07| 102.1| 0.0|ERROR |Bulk copy failed on table 'public.Infra_import' using delimiter ':'. Error was 'no COPY in progress ' 2013-03-01 14:51:07| 102.1| 0.0|INFORM|Successfully closed Postgre
Hi I am trying to wrote the values of new excel rows to a sharepoint list online but I get the following error "Microsoft SharePoint List Writer: Client-side error: '405 Client Error: Method Not Allowed for url: https://sharepointsite/_api/contextinfo' returned from SharePoint. Error message was: 'The HTTP method 'GET' cannot be used to access the resource 'GetContextWebInformation'. The operation type of the resource is specified as 'Default'. Please use correct HTTP method to invoke the resource.' " I read elsewhere that this was resolved previously by an update. Any idea of a work around or anyone else know how I can resolve so I can use as an automation on FME Server?
I need to transform a big ECW (30GB) into a GeoPackage. I think I do not need any kind of processing of the data, so the workspace is pretty simple: That works fine with small rasters, but the big one is draining all my computer resources (being honest, those are not that great...). The obvious solution is executing this workspace in a better computer with enough RAM, but I wanted to try something else.I have created a "parent" workspace that builds a grid. Then, I call the "child" workspace and clip the ECW with a cell of that grid using the Search Envelope parameters of the ECW Reader. If the Tile Set Name of the GeoPackage Writer is a static value, the result only contains the data of the last cell of the grid. The data is overwritten even though I have made sure the checkbox for Overwrite Database is unchecked:I guess, that check is not for what I thought.If I use a dynamic Tile Set Name for the GeoPackage Writer, all the data is stored; but each cell in differe
Is there a way to use both parameter options with a DWG, i.e. Read Model Space Entities Through Viewport - Yes and Read Model Space Entities Through Viewport - No?I have some features, like text, that need to be tested for text height and thus need the 'Read Model Space Entities Through Viewport' set to 'Yes' as this will give me the paperspace size for the entities.If I have the 'Read Model Space Entities Through Viewport' set to 'No', I can test the features that are only in either paperspace or model space but can get the paperspace text size for through features displayed through a viewport. Any suggestions on how I can determine what is only in model space and only in paperspace but get the paperspace size for all features?
A Rest query resulted to a JSON result which includes a URL to another JSON file from the host server. I want to download that JSON URL so I can save it on my computer and then read it as well.For some reason just passing the URL from the JSON flattener and configuring the dataset of the FeatureReader with Format: JSON with that url attribute is not working.It would be good to just implement this with FME Server as a download service but right now I'm limited to Desktop. At the very least I want to read the JSON from the server and it's also not working either.I tried File Copy Writer by parsing the json filename on the URL and it did not work either.
Hi, I am trying to figure out how to write into AutoCAD Civil 3D Pipe Network from a esri file geodatabase?The main reason is that we store all utility data (material, diameter, install date, disposal date, asbuilt) in the File Geodatabases, but would like to pass that data directly to the engineers who work in AutoCAD.I have read sample Civil 3D pipe networks from the engineers to try to figure out how the data is set up, but I am still unsure of how to write the GIS data out so that the engineers have all the extra attributes.Thanks!
I have been working on a proof of concept to take an Esri XML Workspace Document (exported from Esri), and have a user run a workbench on FME Cloud to convert it into a HTML report.I finished creating the workbench locally (FME Desktop with ArcGIS 10.6 installed) using the Esri Geodatabase (XML Workspace Document) reader and went to publish to FME Cloud and discovered it won't run since ArcGIS isn't installed on the machine:Module 'GEODATABASE_XML' is unavailable for use with this FME editionI looked around and found this article which explains why: https://knowledge.safe.com/questions/43509/how-should-we-add-esri-support-on-fme-cloud.html. My question is this - can I use the generic XML reader instead to read in an Esri XML Workspace Document? If so, where do I start?Example of XML: This is what it looks like with the Esri Geodatabase (XML Workspace Document) reader:
Hello. I'm using FME Desktop 2019.Basically I have a Postgis table where the column names are in lowercase and I want to write to an ArcSDE Geodb table but I want to have only the column names changed from lowercase to uppercase when writing to the ArcSDE table. Only the column names, not the record attributes. I want to leave the record attributes the same.I've tried using the BulkAttributeRenamer but this will change the column names to uppercase but then it messes up the type and width of the column (fields).Any guidance would be much appreciated.Thank you.
Hi I found that FME converts IFC Relations to some attributes such as ifc_is_containd_in and ifc_decomposed_by but for me these attributes don't have any value. I've selected these attributes in Format Attributes but still there is no value. Also, I tried GeometryPropertyExtractor and AttributeExposer but nothing changed. Is there any way to extract IFC Relations in FME?Thank you in advance.
Hi, I used to read my ESRI database with the ArcSDE Legacy Reader which worked fine. When I switched to the new GEODATABASE_SDE reader, my ESRI lines that have a cross over that looks like an arc are now read as an IFMEPatch which is a combination of an IFMELine and an IFMEArc. With the Leagacy reader the same line is read as a Line and not as a path of a line and an arc. Is there a way to force it to be read as a line as before? If not possible what would be the best way to convert it as a line? Thanks,Simon
If I use the DWG Reader setting 'Read Model Space Entities Through Viewport' set to Yes, is there a way to determine which features are being read through the viewport?I need to be able to test all features in the DWG but want to test features only based on where they originate from i.e. model space or paper space.
Hello, I am working on converting GIS data to a CAD standard. I have a template file, but the template file has root information (e.g. pipe, manhole layers) but I need to also include status information in the layer name (e.g. pipe-new, pipe-existing layers). I cannot seem to be able to create the new layers with the information from the template layers. I have a spreadsheet that has the name of the layer, the color, linetype, and description. I would like to be able to set the writer to use this information when generating the dynamic layer (e.g. pipe-new). Here are the things I have tried to resolve this:Used DWG Styler - This might work, but it doesn't allow for description and it also doesn't use acad index colors as inputsautocad_color attribute - This attribute is feature specific and does not apply to the full layer. It does make the output look right visually, but it does not follow the layer standard.I appreciate any suggestions you might have on how to do this.
Hey there,I'm new to FME, sorry if it is a newbie question. My pipeline result is the following:I would like to create a text file with the following structure grouped by Template_Prefix and Template_AttributeList::Template=$CM_FT_IndexBi :TagName, Area, DailyInstantVolume.Direct.PV.InputSource, ......etc <content of line#1 column "Value" here> <content of line#2 column "Value" here> <content of line#3 column "Value" here> :Template=$CM_G_VV :TagName, ActiveEnergy.PV.InputSource, Area, Description......etc <content of line#4 column "Value" here> <content of line#5 column "Value" here> <content of line#6 column "Value" here> <content of line#7 column "Value" here> :Template=$CM_PT ....etc...How would you approach it ?Thank you for your help !Best regards,Oli
Heyhey and happy new year, Im fascinated with the 3D PDF possibility of FME and am constantly making some needlessly-over-complicated things in it (of course)Up to now I have mainly just been taking either stuff straight out of Revit for buildings/structures to a 3D PDF or draping TIN's with areal photography or other rasters to make nice 3D landscape.Now I want to include vector data in my landscapes, for example not only drape a TIN with areal photography but also drape it with contours (lines) and areas (polygons) and even perhaps somekind of a structure (based on a point).Ive googled around and tried many things but I just have not succeeded, so could anyone suggest a workflow where I:-Introduce vector data (point. line, polygon)-Set the symboligy of that vector data (color, thickness, opacity...)-Drape a TIN with that symbolized vector data (Use the 'Appearance setter'?)-Export that to a 3D PDF (remembering that I already know how to make it with Raster and TIN, just n