Skip to main content

- - Community Resources
Ideas
Product Updates
Events
Blog

EN

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,703 Posts
24,707 Replies

When you subscribe we will email you when there is a new topic in this category

6703 Posts

Recently active

Most replies Most views Newest first

Troubleshooting blank html from laspublish/potree

I'm working with the Laspublish transformer to view point clouds in potree. The script runs fine but results in a blank html document. I have confirmed that the original Las data is valid via Data Inspector.Even the side bar css or html code does not seem to be rendering correctly.Any help is greatly appreciated!

nagContributor

What is the change in api token id generation in FME Server 2019 vs 2015

Hello Team,We were using a .Net code to generation API token to access FMEServer in 2015 version, Which was working fine.Recently we upgraded to FME Server 2019 tried accessing FME server with same source code which was using in FME Server 2015, was throwing an error as "No token was found for user id XXXXX". Could somebody help me to resolve the issue. Also let us know what is the change in token id generation using FME Server 2019? Does we need to update our source code to generate Token with 2019 version? Thanks in Advance!!!

Installing ArcGIS Pro on FME Server - FME Server Web Interface is down! SOS!

We have FME Server 2019. I want to run some python that uses arpcy from ArcGIS Pro.ArcGIS Pro installation requires Microsoft dot net 4.8. I have installed it and restarted the server machine.Now our FME Server web interface did not come back up. FME server seems to be running. But we can't access the web interface. 1. How do I fix the web interface for FME Server? Is it dot net that causes the problem?2. Has anyone successfully used arcpy from ArcGIS Pro on FME Server?

I have a question about columns with even and odd numbers.

I have a question about columns with even and odd numbers. If I have two columns of even and odd postal numbers I can create a single column of addresses with even and odd numbers? Address EVENAddress ODD2547698111013 Address (ODD and EVEN) 2 4 5 6 7 8 9 10 11 13

jalejandroruizc

How Can I write in a Smallworld DB field, with an associate catalog?

Hello, I am trying to write to a Smallworld DB, in a required field (Nominal Diameter) associated with a catalog and I get the following errors: "Smallworld Translator Error: The '4' value of Nominal Diameter field does not map to an entry in the Main Catalog catalog.Smallworld Translator Error: The '3' value of Nominal Diameter field does not map to an entry in the Main Catalog catalog.Smallworld Translator Error: The '2' value of Nominal Diameter field does not map to an entry in the Main Catalog catalog". Those values are present in the catalog, but the writer cannot find them.Any recommendation to use Smallworld catalogs?Thanks in advance,Jesus Alejandro Ruiz.

helmoetzContributor

OGR invalid element reading GML

Hi @erik_jan or someone else, I am stuck reading a gml file with an OGR namespace in it. FME generates the reader feature type correctly, however, when I run the workspace (FME 2017, even with only an inspector attached to the feature type), it seems that whatever I do, FME throws an error: XML Parser error: 'Error in input dataset:'C:\xxxxx.gml' line:15 column:10 message:invalid element name 'ogr:''The XML Module halted on error, see the logfile for details.The logfile gives me only this:A <schemaLocation> in the uri-map is overriding the namespace 'http://www.w3.org/1999/xlink' xsd location from 'http://schemas.opengis.net/gml/3.1.0/xlink/xlinks.xsd' to 'xlink.xsd'A <schemaLocation> in the uri-map is overriding the namespace 'http://www.w3.org/1999/xlink' xsd location from 'http://schemas.opengis.net/gml/3.1.0/xlink/xlinks.xsd' to 'xlink.xsd'<GML_1 Reader> - Using the current GML 3.2.1 reader to read v3.1.1 and v2.1.2 documents.<GML_1 Reader> - Map Embedded Ob

How to create point labels in 3D PDF

Hi, I would like to create a 3D PDF-File with 3D-points and I need to label this points.In 3D PDF-File I get only points but not labels:And in FME-Inspector I get also labels: How can I do it? RegardsZoran

Télécharger via url

Bonjour à tous ! http://files.opendatarchives.fr/geoport … e.gouv.fr/ est-il possible de télécharger les données depuis ce lien ?

Tiff reader fails value for tag "Make" contains null byte in value;

Hi I am just starting to work on converting multipage tif files to pdf. Testing small files of less than 7 pages has worked fine . now I am testing the actual data set and I am getting this error on the first page of the tif file. TIFF reader: TIFFFetchNormalTag:ASCII value for tag "Make" contains null byte in value; value incorrectly truncated during reading due to implementation limitationsTIFF reader: TIFFFetchNormalTag:ASCII value for tag "Model" contains null byte in value; value incorrectly truncated during reading due to implementation limitations I barely understand how the tiff reader works and can see no configuration for tagvalues . Clueless as to what this can mean.

chauContributor

Problem with automatic field name mapping when using a FeatureWriter to write ShapeFiles

I am trying to use a FeatureWriter to write my features out to a ShapeFile. When connecting the last transformer to the FeatureWriter the FeatureWriter automatically determines how each field name should be renamed (in case a field name is longer than 10), but it doesn't connect each attribute to the renamed field names. Thus when running the workspace it fails when trying to write a feature:FeatureWriter (WriterFactory): Field name 'ID_NAMESPACE' is greater than the maximum 10 character lengthIs this on purpose? The "Automatically connect attributes" option on the connection to the FeatureWriter is disabled, so I can't fix it that way. The only way I can think of is to manually rename all fields to match those chosen by the FeatureWriter.The workspace has previously been running without problems in FME 2018 or FME 2019.I am using FME 2020.0.0.1 x64 on Windows 10.

ESRI Shapefile to ArcGIS Enterprise Portal (overwrite daily)

Hi all, So I have successfully read in a shapefile to FME and written it to our ArcGIS Enterprise Portal. What I next want to do is send an updated version of the shapefile into Portal, overwriting the existing version (as this feature will be added into maps and dashboards etc.). However I have tried to do this in several ways and it isn't working. The shapefile is very simple, a 'provider field' a 'total field' and an 'easting' and 'northing' field. The provder field is likely the only attributes which will change, with the values changing regularly. What I tried first was in the writer set the Portal layer to INSERT and Truncate the layer, but this resulted in the layer deleting all attribute values out of 2 of the 4 fields (provider and total)?! So I then tried setting the writer to UPDATE, this this failed as the shapefile doesn't contain a 'objectid' field. Although when I view the shapefile in ArcGIS, it does have an ID field, but

davideagleContributor

Create Hyperlinks in Excel?

Does anyone have any bright ideas. We're trying to write hyperlinks into an Excel worksheet but failing to do so. The old Excel ADO writer doesn't support this (http://fmepedia.safe.com/articles/FAQ/Reading-hyperlinks-from-an-Excel-spreadsheet) but I thought the new one might with perhaps some of the format codes that are now supported in the new writer (http://office.microsoft.com/en-ca/help/number-date-and-time-format-codes-HP005207595.aspx) but it appears not. If you try to be clever and write a concatenated formula string into Excel with either writer like this: =HYPERLINK("http://www.1spatial.com/fme","http://www.1spatial.com/fme") ...FME just writes it explicitly as above... we've even tried adding a return line in the concatenator to no avail. Ironically if you open the results of this and click into the cell and hit return it enables the hyperlink, so it's not a formatting issue either. So, I guess my plea is, has anyone done this or does

How to read XML with GML geometry inside

Hello,I have a XML file with a GML geometry inside (in attach). Moreover I have the XSD file (named: CensusTechSheet).Can I read that file with FME? I suppose: yes. But someone can suggest me how can I do this?Regards Gianpiero

Using variable in a where clause

Just getting to grips with FME, what I'm trying to do is use the where clause in reader to limit the reader to only return records after the last OID of the previous process. Probably simple but I'm struggling a bit

Missing data when writing to FGDB with dynamic schema

Hi All, I hope someone can help me out there. I am writing to a FGDB with dynamic schema, using the "fme_feature_type" to create the feature classes. I am missing 1 feature in every feature class that is written. If there is only 1 "fme_feature_type" record the feature class does not get created at all. Writer parameters image is below, I am taking the Geometry type from the first feature it finds, not sure if this is the issue? but I have different geometry types for 'fme_feature_types", so see it as the only option. Does it use the first feature to define the feature class only? and not write the feature out? Can't see why that should be the case. Image below of; Statistic Summary just before it is written to FDGB of "fme_feature_type", Examples below"- AU1_ADMARE_p has 9 features- AU1_BCNCAR_p has 1 feature- AU1_BCNISD_p has 1 feature- AU1_BCNSPP_p has 22 featuresAfter FGDB is written, image below:- AU1_ADMARE_a has 8 features- AU1_BCN

Excel: Best Way to find the first blank row, then write new data to it / Using an attribute as start row

Hi,I am looking for the best way in FME to find the first blank row in an Excel Spreadsheet. I have a way, but there are likely better ways. For now I am using the AttributeFilter to give me all of the rows that have data and then using a counter to give me the first blank row. If you know of a better way I would like to streamline this:It spits out an attribute named RowToWriteTo and it gives me row 127 which is correct. However, I am not sure how to use this in the writer. I am needing it to write one new row of data to the first blank row in that same spreadsheet and then save it. In this case, row 127. Next time the workspace would be run it would be row 128 etc. etc. So the row number is dynamic each time the workspace it run. My problem has been keeping the existing data and then just adding that one row to it. Perhaps that is a writer issue. Not sure? Any ideas would be helpful!I would think the correct way is to set the Writer Mode to Update? Or should it be Insert?

IFC Readers produce an error ISO 10303-21

Hi folks,Each time I tried to read an IFC file in IFC reader I got an error states that “ISO 10303-21: the input data file has a syntax error in instance ‘’#879 ” I tried several IFC files but I got the same error, how can I fix this? Cheers,Rawan

Insert and update behavior when read information from a spreadsheet to write in a database

I did a POC where I needed to: 1. Read information from an Excel spreadsheet and the insert this fields in certain tables in my postgres database tables. This went fine once. But, when I repeat the process the same "n" numer of rows are inserted again. This is wrong since no change has occured. 2. After the first insert I need to update only the rows or fields that changed in that period. As I stated above, whenever I run the flow again and again more rows are inserted (indeed, the same rows are inserted). Is there a way to arrange my model in a fashion that this requirement may be implemented? I mean. Insert once and update incrementally as needed? If so, how? Is there any documentation about it? Regards!

franco69Contributor

AUTOCAD WRITER Unused Objects

Hi there Guys, i had a topic about few days ago..... i have an autocad file where i want to write not all layers from the template (only the layers which comes with an feature type in the reader).....tha i solved with help from you with the parameter: PURGE UNUSED OBJECTSSo now i have following problem with one layer:layer 0 has a block included which i have to explode and also use block feature type for components i have set on YESthis block has include some layers i dont want to write (because of purge unused.....) but they be written. (maybe because they are originally included in a layer which has a feature type?)how can i explode the block, take the original layer definitions with me and filter the not used layers (parameter?)I've tried also the REAL DWG WriterThanx and GreetzFranco

Colour conversion from PDF to tiff

Hi,I have a PDF-map (image without marginalia) generated from ArcGIS Pro that I want to convert to a GeoTIFF (8-bit palette) and use as raster data. The colours look fine in the PDF but somehow come out alot darker when i convert them to GeoTIFF. This happens if I export as an RGB as well... Is there a colour handling property that I have overlooked or is this a common issue between ESRI and FME in their PDF reader/writer? Source PDFOutput GeoTIFF

dhavanv2Contributor

NetCDF writer - would like to output one file with 100+ bands and multiple variables, but as compact as possible

Hello, I am new with the NetCDF format so apologies if there is something obvious I am missing.I have a bunch of GeoTIFFs which I am reading in and extracting some variable information from. Then I use a RasterBandCombiner to go from about 150 raster features to 1 with each of it now a band. When I write this out as a NetCDF file, it is about 85 MB. All the Geotiffs combined were about 220 MB.A colleague of mine has tried this using Python (gdal, netcdf4), and is able to translate all the data into the netcdf file that is only 3 MB.It would be cool to have this workflow set up in FME for subsequent use. So I was wondering if there are any parameters or transformers in FME that might help with this? Is it possible to only write out the non-spatial data? I tried using a GeometryRemover, but the writer gave me a fatal error which said it requires raster geometry. Is this why the file output from FME is so much larger in size - the geometry?I also tried bringing in the 3MB file in to FME a

Support for GML 3.3 LRS?

GML version 3.3 adds support for Linear Referencing Systems (LRS).Apparently FME only supports GML up to version 3.2.1:https://knowledge.safe.com/articles/888/reading-xmlgml.htmlI've read elsewhere that "GML 3.3 is itself a GML 3.2.1 application schema".Does that mean FME can read and/write LRS data in GML 3.3? If so, how?Thanks.

I have a SDE Geodatabase with over 1000 featureclasses. I am wanting to select 30 of these and copy over to a Geodatabase. I am selecting these featureclasses by there name. What transformer do I need ? is it Tester ?

WFS write to PostGIS result failed to open in ArcGIS. Error: The field is not nullable

Hi,I'm a bit new to FME so pardon me if the question is basic: I use FME Workbench 2018.1. I have a PostGIS table with 1035 polygon features which needs to be updated (Table A). The update source is a WFS layer with 27 polygon features, among which 26 are updated features and 1 new feature to be added to Table A.The workflow is as follows:1. Since the WFS has a different schema to Table A, I use AttributeManager to make the WFS attribute table consistent with Table A. 2. I use Tester to filter out the 1009 features that don't need to be updated.3. I write the filtered 1009 features and the 27 updated/new features from WFS to Table A, hoping to get an updated layer with 1036 features. I have the following feature type settings:-Table A has a column 'gdb_geomattr_data' which seems to store geometry, so I set the Spatial Column of the writer as 'gdb_geomattr_data'-Table definition set to 'Automatic'-Create Generic Spatial Columns: No-Bulk Insert: No-Table n

FME to Socrata job not working with Socrata Covid Map

EDIT: After doing steps below I now am able to update the LOCATION field but no new records are being being added when I run the FME job. Any ideas?I'm attempting to automate reading an Oracle database and writing to a Socrata dataset using FME workbench 2018. Everything was working except that every time I ran the job I had to manually set the lat/long columns in Socrata to get the map working.I googled the issue and found this documentation: https://support.socrata.com/hc/en-us/articles/207040527-Working-with-Point-Data-Using-the-FME-Socrata-WriterThen I did the following:I used attribute creator to create a new field called LOCATION that concatenates the latitude and longitude columns so that the values look like “POINT (-87.61694 41.70737)”. This location field is already setup in Socrata as a point geocoded column.I have attached a screenshot of my workbench and the new Location field below.When I run the workbench it gives me an error, and although the LOCATION field is popul

1
...
66
67
68
69
70
71
72
...
269

Page 69 / 269

Badge winners

nielsgerritshas earned the badge Thumbs Up for OGC Formats
fakimocherehas earned the badge Student (Grey)
fakimocherehas earned the badge Welcome Back
tomerbublick1has earned the badge Student (Grey)
tomerbublick1has earned the badge Welcome Back

Show all badges

29,736: Posts

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK