- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,814 Posts
25,108 Replies

When you subscribe we will email you when there is a new topic in this category

6814 Posts

DWG is showing custom linetype as solid line

Hello,I am creating dwg files using autocad template and DWG Styler. But when I opened the file in AutoCAD I am not able to see the linetype, instead it shows solid line. But as soon as I execute command REGENALL the linetype is displayed correctly with linetype.I have set autocad_linetype_generation=1 in fme, The scale is also fine, also I could manually create the linetype in autocad,I have done everything as mentioned in this post https://knowledge.safe.com/questions/83076/enable-linetype-generation-for-dwg.html I dont know if this is FME issue or AutoCAD setting issue.Has any one observed this or has any suggestion? Regards

MITAB Reader: Failed to open and parse file Make sure that the file exists and is valid

Hi All, I have a workspace published to FME server with a few MI tab readers, nothing special. (read several MI tab files-> manipulate attributes -> extract coordinates -> output to CSV). For whatever reason when the job runs per its scheduled time, It fails with the following error in the log:MITAB Reader: Failed to open and parse file 'E:\\ProgramData\\Safe Software\\FME Server\\repositories\\Workspaces\\SSALocator\\RUR_ADS_PROPNUM.TAB'. Make sure that the file exists and is valid The tab file is located on a network share so i'm not sure why its referencing the location above? Theres no files here other than a copy of the workspace. It doesn't have a long path name (>260) If i manually click resubmit job, it works fine so i don't believe its file access(I used the full UNC path for the readers). Any suggestions are appreciated.

250

4 years ago

drc43Contributor

asked in Data

PDF Text Justification

Is there a way to set the justification of text in a PDF writer? I can't find anything in the PDFStyler transformer or any Format Attribute in the writer to control this and this article doesn't mention PDF. https://knowledge.safe.com/articles/16546/text-justification.html The text feature class I'm reading from has the text justified as center, center, but when I write to PDF it shows up as top, right in relation to the anchor point.In GIS:In PDF:Any one have any ideas?

PostGreSQL: non-spatial data reader

Hello,I have FME 2018.1 and PostgreSQL 9.4.I try to create a reader with non spatial date so I could join them with spatial data but it seems FME can't reader the features in the non-spatial table.I tried to open it in the Inspector but it doesn't work too: Opening POSTGRES reader for dataset 'cadastre_2019'PostGIS client encoding: 'UTF8'PostgreSQL 9.4.0, compiled by Visual C++ build 1800, 64-bitSuccessfully closed POSTGRES database readerSuccessfully closed POSTGRES database readerMerged 1 schema features read from 1 datasets into 1 resulting feature typesSaving spatial index into file 'C:\\Users\\J\\AppData\\Local\\Temp\\FFS_1579770320565_8204_DATA.fsi'Finished saving spatial index into file 'C:\\Users\\J\\AppData\\Local\\Temp\\FFS_1579770320565_8204_DATA.fsi'Removing dataset 'cadastre 2019 [POSTGRES]' from View 1Successfully closed POSTGRES database readerThe dataset 'cadastre<space>2019' was closed successfullyThe 'P

Choice multiple and generic writer

Hi folksI created a "choice multiple (with alias)" parameter, for several writer's format (MID-MID, DWG ...)and I would try to use with a Generic Format Writer, for instance, to produce a DWG and a MIF-MID simultaneously.when I choose more than one format, it do not work.Is it normal ? I attach the workspaceregards

4 years ago

biboba

asked in Data

Expose SDE archived table fields GDB_FROM_DATE and GDB_TO_DATE

Is there a way with an ArcSDE Reader with an archived clause to expose the attributes GDB_FROM_DATE and GDB_TO_DATE ?Thanks

How do I upload shapefiles to FME Server?

I have built a workbench that takes a shapefile (which isn't one file) as an input. I've published it to FME Server. How do I upload a shapefile(s) so that FME Server will process it?

dynamic writer to write empty feature classes

I have a series of feature readers that read data and schema from a postGIS DB and writes to a GDB using a dynamic writer and the schema feature generated from the Feature reader (see image). For some data I have empty tables and FME does not seem to write the corresponding feature class in GDB if no features are found. Now, what I would like to achieve is to force FME to write every feature class (corresponding to a table in the DB) even if the table does not contain any data. Ideally I would need an empty feature class with one row and empty data but also an empty feature class is fine, as long as there is the schema, that would be the requirement. Is it easily possible to achieve in FME desktop?

I am getting an error message

I am getting the following error message when I try to connect a reader to a read-only Arc SDE connection "Unable to read from the table/feature class 'GDM.GasValve'. If 'GDM.GasValve' contains a class extension, make sure it is registered on this computer"I would appreciate if i can get any help with getting round this.

4 years ago

gogopotter90Contributor

asked in Data

how can i search for ia line that has id in my shape file

I would find it helpful if it's possible in FME Desktop to search for a line that has id in my map (shape file ) ,if find it .so check the data and do something if not so do something else .could i ask ,which type of transformer could i use for search in the map for data but iam not sure if my map will has this data or not ,just for check .

4 years ago

thdrgContributor

asked in Data

Opinion on the combination of FME and postGIS

Hello to the whole FME community! I have a very simple and basic question to ask you.I work with large volumes of hydrographic data, address data, etc. and soon lidar data.With each treatment / test I perform, my files often duplicate and it becomes easy to get lost in this mountain of data. So I would like to have your opinion on the advantages that I would have to use a database management system (PostgreSQL with the PostGIS extension) For now, I think that this would allow me to: - better manage the storage and versions of my files- optimize the transitions between my files and FME (by directly connecting my DB in FME)- increase the speed of loading and writing my data- get my data instantly in QGIS (by also connecting my DB in QGIS)- to decrease the storage space of my files given that they will no longer be stored in shapefile (+ dbf + shx)? Tell me if I'm wrong, and if you have other advantages to list me, I'm interested! :) Thank you !

520

4 years ago

alfonsContributor

asked in Data

3D Shapefile with 3DForcer?

Hello, i'm pretty sure it's a simple problem, but somehow i'm not able to write a 3D shapefile. Every time I look at the feature information in the Data Inspector, I get "2D" as the dimension. But I need "3D" as dimension. As a test, I have written the script below. After I have created a "test point", I create an attribute with a height, which I write into the Z-value using the 3DForcer. When exporting I want to write a 3D shapefile, but I have some kind of error and I can't see the forest in front of the trees anymore. Thanks a lot for the help

Problem writing INSPIRE Administrative Units GML

Hi! I'm using FME 2019.1 with INSPIRE Solution Pack and I'm trying to write an INSPIRE Administrative Unit GML from a shapefile (SHP) that contains some multipolygons. The problem is that the resulting GML does not contain the multipolygons geometries (but the features).SHP (reader) GML (writer) To assign values to the GML fields related to GeographicalName, I use 2 aggregators: one to generate the list "GeographicalName.spelling" and another to generate the list "name", both of them grouping by UUID.However, when doing the same (from the same SHP and using the same transformers) to write an INSPIRE Geographical Names GML, multipolygons are included.Is there maybe any issue with the INSPIRE Administrative Unit GML schema?Comparing the resulting GMLs, Administrative Unit vs. Geographical Names, I see that the first one does not have a MultiGeometry tag.Thank you so much,

200

4 years ago

f.kemminjeContributor

asked in Data

How to drop and create Mongodb collection(table) ?

I am reading from oracle spatial table and writing to Mongodb. once I written to mongo with some sample data, and i want to re run my fme script again for whole, by drop and create method(mongo db collection). I set the writer option to "drop and create", but its giving error. error msg saying thatMONGODB writer: Layer layerDataPolygon already exists, CreateLayer failed. Use the layer creation option OVERWRITE=YES to replace it.(red color)where to set OVERWRITE=YES(layer creation option) ? as per fme's error msgCan anyone pls help?

What does Excel Reader warning invalid value '' for parameter 'xlsx_start_row' in 2019.2.2.0 mean?

Since upgrading to FME Desktop 2019.2.2.0, when I run FME workbenches with excel readers I get the warning:"Excel Reader: Sheet 'mysheetname' has invalid value '' for parameter 'xlsx_start_row'. Parameter will be ignored""Excel Reader: Sheet 'mysheetname' has invalid value '' for parameter 'xlsx_end_row'. Parameter will be ignored" I never got this before, previously i was running 2019.1.3.1. What does it mean and is it a problem?

600

4 years ago

tnarladniEnthusiast

asked in Data

task scheduler can't run workspace connecting to arcgis online feature service

ok. so there have been a lot of questions about running a workspace through the task scheduler (and the fact that it doesn't work) with running it manually.I have tried all the solutions suggested.Problem:I have a workspace that logs onto an AGOL account, retrieve the data and create an excel.I have no problem running this workspace manually when I am logged on to the server.The issue is when I schedule this to run using a service account. I get this error:ArcGIS Online Feature Service Reader: Connection 'Esri ArcGIS Online' does not exist. Check connection parameter and connection definitions in FME options and try again Solutions I've tried:(moving the data and publick key into a public location) https://knowledge.safe.com/articles/34678/making-database-and-web-connections-public.html(editing the registry) https://knowledge.safe.com/articles/32356/scheduling-software-doesnt-recognize-fme-connectio.htmlset the task to run with highest privilegesset the "Start in&q

Hi,I don't know much about FME, but there is no ESRI support for S57 Data to get a GDB without getting more expensive Tools. So I found a model of FME Workbench from rylanatsafe (https://knowledge.safe.com/articles/570/s-57-enc-hydrographic-data-format.html)But when I run that model,I get the Error:"Could not create a GEODATABASE_MDB writer. Personal geodatabases are not supported with 64-bit versions of FME and ArcGIS. Plugin 'GEODATABASE_MDB' was loaded, but a writer could not be created. Error was #1: A fatal error has occurred. Check the logfile above for details"Is there any way out? So I need the s57 Data as a GDB with the symbologie of s57 data. (ENC) Thanks for attention.

Split multiText DGN - Additional features created

It is only possible to rotate text (fme_rotation; or set idgs_rotation to 0) if the text is splited (split multi text - reader parameter).If the text is splited, there are additional point and line features (with length 0) in the output drawing (looks like the insertion point of the text; see attached picture).Is there a way to rotate the text without the additional objects.

Is there a way to 'IGNORE_UCS' when reading in dgn files? I have heaps of dgns with different user set coordinates systems. The dwg reader has this option but I can't see a way to replicate this setting for dgns.Just to clarify - the dgn are in UTM but each dgn file has a localized UCS set by the designer.

4 years ago

dewan

asked in Data

Separate two different entities from one column

Hi, I have a column named DateTime in a table. The format of date and time is as follows: 9/9/2009 21:23:31 25/12/1991 8:3:23 means There is a space b/w date and time. Date Month Year is seperated by '/' and time by ':' Now, I need to seperate date and time. I want two new attributes Date and Time with respected outputs. Thanks in advance.

PostGIS - Bulk copy failed, server closed connection

Hi Fme:ers, I have a problem inserting data into PostGIS with FME2013. Sometimes it fails after 500 000 objects and sometimes it occur after 5 000 000 objects. Feels like a server/network problem but cant figure it out. Anyone experienced this? 2013-03-01 14:51:07| 102.1| 0.3|ERROR |Bulk copy failed on table 'public.Infra_import' using delimiter ':'. Error was 'server closed the connection unexpectedly This probably means the server terminated abnormally before or while processing the request. ' 2013-03-01 14:51:07| 102.1| 0.0|ERROR |A fatal error has occurred. Check the logfile above for details 2013-03-01 14:51:07| 102.1| 0.0|ERROR |A fatal error has occurred. Check the logfile above for details 2013-03-01 14:51:07| 102.1| 0.0|ERROR |Bulk copy failed on table 'public.Infra_import' using delimiter ':'. Error was 'no COPY in progress ' 2013-03-01 14:51:07| 102.1| 0.0|INFORM|Successfully closed Postgre

Sharepoint writer error 405 issue

Hi I am trying to wrote the values of new excel rows to a sharepoint list online but I get the following error "Microsoft SharePoint List Writer: Client-side error: '405 Client Error: Method Not Allowed for url: https://sharepointsite/_api/contextinfo' returned from SharePoint. Error message was: 'The HTTP method 'GET' cannot be used to access the resource 'GetContextWebInformation'. The operation type of the resource is specified as 'Default'. Please use correct HTTP method to invoke the resource.' " I read elsewhere that this was resolved previously by an update. Any idea of a work around or anyone else know how I can resolve so I can use as an automation on FME Server?

1220

4 years ago

oscardInfluencer

asked in Data

Big ECW to GeoPackage - Overwrite issue

I need to transform a big ECW (30GB) into a GeoPackage. I think I do not need any kind of processing of the data, so the workspace is pretty simple: That works fine with small rasters, but the big one is draining all my computer resources (being honest, those are not that great...). The obvious solution is executing this workspace in a better computer with enough RAM, but I wanted to try something else.I have created a "parent" workspace that builds a grid. Then, I call the "child" workspace and clip the ECW with a cell of that grid using the Search Envelope parameters of the ECW Reader. If the Tile Set Name of the GeoPackage Writer is a static value, the result only contains the data of the last cell of the grid. The data is overwritten even though I have made sure the checkbox for Overwrite Database is unchecked:I guess, that check is not for what I thought.If I use a dynamic Tile Set Name for the GeoPackage Writer, all the data is stored; but each cell in differe

380

4 years ago

deanhowellEnthusiast

asked in Data

Read Model Space Entities Through Viewport

Is there a way to use both parameter options with a DWG, i.e. Read Model Space Entities Through Viewport - Yes and Read Model Space Entities Through Viewport - No?I have some features, like text, that need to be tested for text height and thus need the 'Read Model Space Entities Through Viewport' set to 'Yes' as this will give me the paperspace size for the entities.If I have the 'Read Model Space Entities Through Viewport' set to 'No', I can test the features that are only in either paperspace or model space but can get the paperspace text size for through features displayed through a viewport. Any suggestions on how I can determine what is only in model space and only in paperspace but get the paperspace size for all features?

4 years ago

salvaleonrpEnthusiast

asked in Data

Writing a JSON file from a URL

A Rest query resulted to a JSON result which includes a URL to another JSON file from the host server. I want to download that JSON URL so I can save it on my computer and then read it as well.For some reason just passing the URL from the JSON flattener and configuring the dataset of the FeatureReader with Format: JSON with that url attribute is not working.It would be good to just implement this with FME Server as a download service but right now I'm limited to Desktop. At the very least I want to read the JSON from the server and it's also not working either.I tried File Copy Writer by parsing the json filename on the URL and it did not work either.

1244

4 years ago

Page 90 / 273

Badge winners

tristanjwshas earned the badge Integrate Data with the FME Platform Training
courtney_mhas earned the badge Integrate Spatial Data
geogaardhas earned the badge Welcome Back
ericchezhas earned the badge Student (Grey)
ericchezhas earned the badge Teacher (Grey)

Show all badges

30,395: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.