Skip to main content

- - Community Resources
Ideas
Product Updates
Events
Blog

EN

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,701 Posts
24,707 Replies

When you subscribe we will email you when there is a new topic in this category

6701 Posts

Recently active

Most replies Most views Newest first

timboberooskyContributor

FME 2012 vs 2019 - AutoCAD feature types and Self Intersections

Hello.This is a two-parter question, I hope that is ok. This is a bit of a long post, but both questions are related. And I'll start by saying I don't know much about AutoCAD but..Question #1: I have a question about the Autodesk AutoCAD DWG/DXF reader at FME 2012 vs FME 2019. I know this is a very big leap in terms of software versions, but we're doing an upgrade at the moment so I am going through updating scripts. Where I can, I've been updating transformers to the newest versions. What I've noticed, is that the same dataset read by FME 2012 identifies fme_type / autocad_entity areas and ellipses differently than FME 2019. For example (using the exact same dataset):FME 2012 reads this feature as autocad_entity = autocad_polygon / fme_type = fme_area:But FME 2019 reads the exact same feature as autocad_entity = autocad_ellipse / fme_type = fme_ellipse:I guess I'm just trying to confirm whether this makes sense - I'm assuming geometry handling has been impr

tim_woodContributor

Securing ArcSDE connection files on FME Server

See https://knowledge.safe.com/questions/38060/sde-connection-files-and-fme-server.htmlI might be OK with read only ArcSDE connection files being in a shared area, but ones with write access need to be restricted. So new system share may be the answer.If I have a Workspace with a read only ArcSDE connection and a write ArcSDE connection, I can't seem to choose separate locations on server for each one - they both have to go in the same place (that's using FME 2018). So it looks like I will have to create a Workspace with the read only connection file and publish that to upload it to the shared area, then use that in Workspace with the write connection file stored locally.Is there no way to load ArcSDE connection files into the shared area outside of Workspace publishing? Can you just copy the files to the appropriate folder on the FME Server server?

How extract specific element in HTML Table

Hello, I want to get the value from <a> tag in the following HTML table, someone has an idea how can I get it? I tested HTML extractor, FeatureReader, but don't return me "Website". Thks<table id="myTable"> <tr> <td>hello</td> <td>it's me!</td> </tr> <tr> <td>it's just a table <a class ="myClass" href="https://example.com">Website</a></td> <td>with two columns</td> </tr></table>

how to make this json into geometries in fme

I've got some data in json which have some different geometries in it I want to read these with FME and output geometries, polys, lines, etc I attached the files, do I need to somehow change the way the coordinates are formatted' to be able to create the geometries? How do I best go about this in fme? also have pretty much the same data in xml, attached that too.my plan was to extract the coordinates with attributesplitter but that got troublesome for anything other than a point feature

fmelizardContributor

SDE Connection files and FME Server

When I publish a workspace that uses an SDE Connection file where do you recommend storing them? Our IT changes database user passwords regularly and this makes it difficult to keep the SDE connection files published to FME Server up to date.

joe_pContributor

Problem writing to Azure Cosmos DB

Hi all, I'm having a problem writing to Azure Cosmos DB where I format the attributes as in the image below and use the Azure Cosmos DB writer to write to the DB. When I test connection and write it says all good however when I go to view the data I get this error and the data hasn't been written. ActivityId: e39bb0d8-2a86-45db-bb62-d50efecc43b7, Microsoft.Azure.Documents.Common/2.9.2' A fatal error has occurred. Check the logfile above for details Failed to specify the feature index as constraints on the reader Cosmos DB (DocumentDB) Reader: Request failed with HTTP status 400. The message from the server is: 'Cross partition query is required but disabled. Please set x-ms-documentdb-query-enablecrosspartition to true, specify x-ms-documentdb-partitionkey, or revise your query to avoid this exception. Any help would be very much appreciated! Thanks Joe

bigapplerizzi19

split csv from a line including a specified text

HiCould you tell me the procedure to split csv from a line including a specified text.

Error ArcObjects is: '-2147418113'. The error message from ArcObjects is: {}

I have an strange problem with an Enterprise Geodatabase writer.We just migrated from FME Server 2018 32bit to FME Server 2019.2 64bit.Which also means an upgrade to ArcGIS Pro 2.4.I have the following error with writes to an Geodatabase.An error occurred while attempting to store a row into the table 'GEOEDIT.TennetBekendmakingen_vlak_totaal'. The error number from ArcObjects is: '-2147418113'. The error message from ArcObjects is: {} Watch the ArcObjects error. No clue 'that helps'. I had this error at the end of an processing of WFS data to Geodatabase.To troubleshoot this problem (WFS read has a lot of data so is slow) I wrote te data to insert in the geodatabase to een FFS file.I made an new workspace that reads the FFS en writes to de Geodatabase.In my first attempt the write succeeded.So I decided to implement this on FME Server. Orignal workspace writes to FFS. And the second one from FFS to GeoDb.And then the funny bit starts.I've made an automation

Can't get invert elevations when translating from Civil 3D to shape

When converting Autodesk Civil 3D data (specifically pipes and structure for creating water, storm and sanitary features in shape or geodatabase) with FME, I am not getting any invert elevations. The newly converted features have some AutoCAD attributes in HEX (assumed) format, but non of them make sense as invert elevation when converted to decimal. The export LandXML file from the same Civil 3D does have those invert elevation that could be read as part of structure description, so it is there, just can't get it out into GIS. I really wanted to avoid the process of manual entry of those invert elevations every time I need to add new developments to the infrastructure features. Any help on that?

Preserving the ObjectID datatype in a file Geodatabase

A selection of features from an Oracle database by means of an Esri Geodatabase (ArcSDE Geodb) reader gets exported to a file geodatabase. The original database table has an ObjectID field which is unique. However, the reader considers this field as of type Integer. In de exported file geodatabase this field is still of type Integer. A python script compares the original table and the table in the file geodatabase on the basis of a common field of type ObjectID, which obviously fails.Is there a way within FME to change the field type from type Integer into type ObjectID or should I take an alternative route?

FME Cloud Access To on Premise Server

Can FME Cloud be configured to access my local network drives? For example, could I read something from ArcGIS Online and write it to a shapefile or FGDB on one of my on premise servers?

Bathymetric attributed grid (BAG) to database

Im trying to import a BAG file in a database. A bag file has 2 bands (elevation and uncertainty) and a metadata string. I want to import the 2 bands and the metadata features to their own column in a table. When I try to import the metadata string it imports the whole string to one column called: Bag_metadata_string. I have no experience with the xml transformators. I tried to export the string to a xml file and continue with that xml file to import in a database. It worked almost but not completely. When I export to XML it changes the < > to something like &gm; and &gl;When i changed them back in notepad to < > it could be used to import to a database. Unfortunately it created only the columns and didn't import the data.What is a good workaround to work with a BAG file so I can export the metadata correctly from BAG to postgis?

How to open large shp file with dbf larger than 5GB with FME Desktop 2018-64 on WIN10-64b

I have shp files with dbf exceedig 5GB each. While using fme to open it and proces I'm getting an error. I'm using FME 64 2018.1 on windows 64b. I can use Qgis to convert but I would like to know how to handle with such files? Link to the file: https://opendata.geoportal.gov.pl/prg/adresy/PunktyAdresowe/POLSKA.zip

Positioning KML popup window with FME

I am creating a KML file with FME. Among other things, it creates popups in Google Earth. All is fine; except when I have multipart polygons, the popup window is displayed between polygons and not on one of the parts. Some users may prefer it that way. I am wondering whether that can be control with a setting in FME? That is that the KML popup windown is originating from one of the polygons.

Transforming csv data

Hi folks, New to the forum and FME, I'm hoping I can leach some knowledge. I have a csv file that imports into FME like this: I would like to manipulate it into the following format: Depending on which file is imported Costs 1, 2 & 3 may be there, or it may be a combination of 1 or 2 costs. All costs do share a common three characters at the left of their name. Is it possible to dynamically look at the cost columns and then transform the data into the format shown in the second pciture? Thanks in advance. Andrew

Creating KML from JSAON

I am trying to convert JSON file to kml. I am inputting data from source file to Attribute creator and picked Latitude and longitude. This was connected Vortex creator then to Coordinate system setter. This was connected to Writer feature type. I ran the sequence, it generated an error that reads "The workspace may run slower because features are being recorded on all output ports. The below feature caused the translation to be terminated VertexCreator_ (TeeFactory): VertexCreator_: Termination Message: 'VertexCreator output a feature. To continue translation when features are rejected, change 'Workspace Parameters' > Translation > 'Rejected Feature Handling' to 'Continue Translation'' VertexCreator_: Termination Message: 'VertexCreator output a feature. To continue translation when features are rejected, change 'Workspace Parameters' > Translation > 'Rejected Feature Handling' to 'Continue Translation'&#

DWG writer text size issue

Hello,I am performing a simple translation that reads in a building DWG file, updates a single attribute (room number), and overwrites the same DWG it read in with the updated attribute. The issue i am having has nothing to do with the translation i am performing but the labels in the resulting DWG. Some of the labels are written out with a text size that is much larger than the original DWG. I have inspected the original drawings text size for these labels, and they are 0.38 but the resulting label text size jumps to 3.06. This only happens on labels that are surrounded by polygon inserts. The labels without these inserts come through just fine. See the attached image where the label for "CORR1" is just fine but "CORR4" is too large but has a polygon insert around it. I have also noticed that the resulting entity handle for this label changes after being written out. Also, when i redirect the writer to fme data inspector, everything appears just as it should.

freddy17Contributor

3D View from CAD to .svg

Good day, I am just looking if someone can point me in the right direction. GoalIfc/Cad File to .svg The goal is to create .svg for PowerBi. By taking a view from a 3d File and saving the view to turn into a .svg file. Below a few screenshots how I have done it before. A .svg is imported into powerbi. When clicking the .svg graphic in PowerBi, the PowerBi table changes to filter only that Column In this example the .svg has the following ID: <polygon id="M1" description="M1" If this ID is found in the PowerBi Data, the column for "M1" is called. ( I have added an example of such an .svg file that I work with: SvgPowerBiExample.txt(saved as .txt file) FME QuestionIs it possible to save a "view" of an .ifc file or Cad file such as .dwg in 3d? Then Vectorize that View and save the internal surfaces as the polygon id needed for an .svg file. For Example, a view in FME that I would like to save as .svg file: My current WorkflowThe workflow is

ridleyjContributor

Published parameter as identity field name does not resolve in feature writer

Using a published parameter such as $(outputTableName) in a SQL writer to name a field.Taking the parameter value to name the identity field as in $(outputTableName)UKID resolves and creates the column no problem when using a standard SQL writer. So, setting the parameter value to "MyOutputTable" results in a field name of "MyOutputTableUKID".When attempting to do the same in a SQL FEATURE writer, the parameter will not resolve, and the column is created with the explicit string value '$(outputTableName)UKID'.Is this behaviour expected between the two varieties of writer?

arthyContributor

How to create disjoint boundaries of disjoint cluster from las?

Hello, I have las file in which some points after some manipulation produce separate cluster of points as shown on the image.How could I produce separate boundaries for each cluster?

lukas108Contributor

Write file in the same directory where source file is

Hello, I need to write the resulting file to the same directory where my source file is, no matter where is the workspace. However, variables cannot be inserted into the writer's destination directory. Can anyone help?

deanhowellContributor

DWG Scale Bar missing units

We have a DWG that has a number of scale bars shown in paperspace. In the DWG the units are visibleBut when it is brought into FME the units are missing. My guess is that the units are dynamically generated in the DWG based on the viewport scale and as such are not really annotation but some attribute / tag associated with the line.Is there a way for FME to find the values so they can then be used to output to PDF. Update 1:Here is a a sample DWG with the issue included. Update 2:What I have discovered is the scale bar is a 'block' and the text is a tag associated with the block. Is there a way to convert the 'tag' to text in FME?

SQL to Run After Writer in both SQL Spatial (JDBC) and SQL Non-Spatial writers

I have 2 dynamic writers in which data are coming from 2 readers (SQL Spatial and SQL non-spatial, respectively). Actually the readers are reading from the same database (A, for example) and the writers are writing out to the same database (B, for example). The reason why I have 2 readers is because there are spatial data and non-spatial tables in database A. I have a SQL script that can set ObjectID to Primary Key. It doesn't seem working properly when I put SQL script into the first writer (spatial). Therefore I had to put this SQL script into the second writer (non-spatial) to make it run properly. Any ideas? Thanks

mmccartContributor

Read only the 1st line of Text/CSV File

I have a CSV file where I need to read only the first line (or first column/line combo) of the file. Is there an easy way to do this with a reader? Or am I stuck reading the whole file? I've tried both the CSV reader and Text File reader. In both, I don't see anyway of isolating this first line of text/data. I'm forced to bring the entire table into the workspace. Thanks in advance!-Mark

clairestoddartContributor

INSPIRE GML - Missing Feature Type RenewableAndWastePotentialCoverage

I am trying to harmonise an average windspeed ShapeFile to INSPIRE GML.In the in EnergyResourcesCoverage application schema there is a RenewableAndWastePotentialCoverage feature type. However, I can't seem to add it as a writer. I only see the option of the RenewableAndWasteResource feature type. Does anybody else have experience with this? Or is there another way to create this INSPIRE GML?

1
...
75
76
77
78
79
80
81
...
269

Page 78 / 269

Badge winners

bwallishas earned the badge Welcome Back
bwnhas earned the badge Expert (Silver)
martijndielemanhas earned the badge FME Form Basic Training
emmaatsafehas earned the badge Enchanted by Attributes
shane.maileyhas earned the badge Welcome Back

Show all badges

29,733: Posts

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK