Skip to main content
  • EN

Data

Using readers and writers to extract and load data.

  • 7,089 Posts
  • 26,099 Replies
7089 Posts
kimo
Contributor
kimoContributor
asked in Data
Create a primary integer autoincrement key in sqlite

I can set an index on an integer or even a unique index, but there is no type for a primary key or autoincrement. How can I specify this? I could do this with an SQL Create expression. Can I use SQL to create a schema?I am adding a changeset with new records using insert but I need an OID column for ArcGIS to be able to use the table/featureclass separate from the real ID.

1980
nielsgerrits
VIP
freddy17
Contributor
freddy17Contributor
asked in Data
Sun Analysis Tools in FME?

I was just wondering if anyone has done sunlight / shading analysis in FME? In Rhino 3d + Grasshopper, Ladybug and Honeybee are plugins that can do this. Below a few images. I know that one can do some interesting stuff with the surface footprint replacer, and change the angles, and thereby create shadows. But thought I would ask before diving deeper. Maybe another option would be to go the ESRI route.  Ladybug:Ladybug Tools | Food4Rhino  CheersFred

2560
dmitribagh
Safer
sameer
Contributor
sameerContributor
asked in Data
Attribute Manager (Import Wizard) - Possible Bug as Attributes are sorted by default

FME(R) 2022.2.5.0 (20230329 - Build 22795 - WIN64 Hello Just detected this possible bug when importing Attribute Names / Values using Attribute Manager. The Names are pre-sorted and the "Sorted" option unticked as shown below. Once the dataset has been imported (Select * for Input/Output/Values) the values are set as shown below. Was I not meant to see the actual values or have I misunderstood this part? Looks like the Attribute Names have been set as values. If that's intended then what could be a potential use case?  Original Attribute Names order / Table structure as defined in the Postgis Db ThanksSameer

390
kailinatsafe
Safer
F
fungergis
asked in Data
FME Sharepoint List Reader issue - returns error 401 when clicking on "Lists"

Hi,I have been investigating this for some time, but did not find any solution so far: In order to read sharepoint lists from a predefined sharepoint site, I used the web connection "Microsoft SharePoint Online (Template)". As testing / reauthentication was successful, I felt ready to read a list from this specific sharepoint page so I inserted its URL and indicated my web connection. However, when I click on "Lists" to retrieve the lists I created, I get an error message (see attached). The error in the log furthermore shows:"Failed to obtain any schemas from reader 'SHAREPOINT' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information" I am using FME 2020.2. Do you know what I am missing here?

3040
data.djz
jsdbroughton
Contributor
jsdbroughtonContributor
asked in Data
CRITICAL: Both DGN and DWG readers fail reporting ACAD2004

In both 2022.2.5 and 2023.0.0, I am unable to read DWG files or DGN files. The translation log reads:DWGAutoCAD Reader: An error occurred for dataset 'xxx.dwg', in function AutoCAD2004Reader::open. Exception thrown: 'Extended error' (The file cannot be accessed by the system. SCENEOE_23.9fme_17.tx) Failed to obtain any schemas from reader 'ACAD' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information Translation FAILED.Error running translation.Workspace generation failed.  Parameter file was C:\Users\JSDBRO~1\AppData\Local\Temp\FME_1683040838597_37964.DGNFME API version of module 'acad/ACAD' matches current internal version (4.0 20220615) AutoCAD Reader: An error occurred for dataset 'xxx.dgn', in function AutoCAD2004Reader::open. Exception thrown: 'Extended error' (The file cannot be accessed by the system. SCENEOE_23.4fme_16.tx) Translation was SUCCESSFULError running tran

770
jsdbroughton
Contributor
dor1411993
Contributor
dor1411993Contributor
asked in Data
PDF writer in Hebrew

HiI have some wired issueI use the PDFPageFormatter to insert to a template PDF all sort of data, some of it in Hebrew and are numbers.I notice that when I insert a Hebrew Characters, It didn't appear on the PDF.Can someone please help me?Thanks!

170
dor1411993
Contributor
siteh2000
Contributor
siteh2000Contributor
asked in Data
I am running a workspace converting DGNs to gdb with no errors but it gets to this message: "FME API version of module 'GEODATABASE_FILE' matches current internal version (3.8 20190621)" and does not proceed anymore any ideas?

I am running a workspace converting DGNs to gdb with no errors but it gets to this message: "FME API version of module 'GEODATABASE_FILE' matches current internal version (3.8 20190621)" and does not proceed anymore any ideas?

130
danminneyatsaf
Safer
lifalin2016
Supporter
lifalin2016Supporter
asked in Data
FeatureWriter and "overwrite file" setting ?

Hi.I'm having trouble with a workspace, that outputs a number of GeoTIFF files to a folder.I'm using a FeatureWriter to output the GeoTIFF's. The FW has no option whether to overwrite existing files.When I save the workspace as a mapping file, and run fme.exe with this mapping file, no files gets overwritten, i.e. older versions remain in the output folder.If I run it manually (i.e. the workspace in Workbench), it seems like files are getting overwritten.Is this the WAD behaviour, or is there a difference between running *.fme and *.fmw files ?How come there isn't a setting in FeatureWriter to control this ? Or is there, somewhere hidden ?Cheers.

2040
W
N
nsadowy
asked in Data
Write to remote MySQL database through ssh

I am able to write to a local MySQL database, but I would like to write to a remote MySQL database through an ssh connection. I don't see that the Add Database Connection interface allows this. Is there a way to do this?

430
arthur_bazin
Contributor
michael_m
Contributor
michael_mContributor
asked in Data
Trying to create a point feature class from an excel file with lat/long coordinates. Getting a "missing column" error. How to I resolve this?

I have an excel file with lat/long coordinates and I'm trying to create points based on them in a file geodatabase. The geometry is being created but I keep getting an error when trying to view the attribute table: "A column was specified that does not exist." I've checked that all the columns are green in the file gdb writer.​If I replace the file geodatabase writer with a shapefile writer everything works fine. Can anybody tell me how to figure out what is going on? Using FME Workbench (Form now?) 2020.1 Thanks, Mike

1030
michael_m
Contributor
I
ingridantonsen
asked in Data
Write to SBG .geo

Hi all!I would like to write my data to a format called .geo which is used in Sweden but is not supported by FME.I attach some sample how the format looks like:FileHeader "SBG Object Text v2.01","Coordinate Document","UTF-8"begin   FileInfo "Application","Geo Professional"    FileInfo "SerialNo","123456789"   FileInfo "Author","Abcdefghijklmnopqrstuvwxyz"   FileInfo "Company","Abcdefghijklmnopqrstuvwxyz"   FileInfo "Description",    FileInfo "Coordinate System","Sweref 99 18 00 / RH2000"endPointListbegin   Point "123456",6580210.000,155715.000,,,,"rör i mark med däcksel"   Point .....   Point....endLineListAttributeList I have a list with points and want to fill in the list in the "pointlist" section.Would this be possible with FME right now?Any ideas or help is appreciated. 

340
I
fikusas
Contributor
fikusasContributor
asked in Data
Assigning values to points on the network

I have to assign line IDs to bus stops (point on the line). All lines are splitted at junctions. Desired result: S1 IDs: 001, 002 (but not 025)S2 IDs: 003M1: 015, 016 (but not 031)M2: 017 Any thoughts?

60
fikusas
Contributor
R
robyn_studts
asked in Data
Smallworld points to Microstation V8i cells are different sizes

I am translating a group of point objects at different rotations from Smallworld to Microstation V8i. The same object in Smallworld and using the same FME translator. The resulting DGN has different size cells to represent the same object. The point objects that are at 0, 90, 180 or 270 are the correct size when translated but other angles translate larger. I am open to any ideas on why this is happening and what can be done about it. Thanks

120
R
R
rb12345
asked in Data
If i have an outline of the UK and coordinates dotted around the UK represented as points, is it possible to create polygons which 'colour in' the UK based on the closest point? and if so, what approach should I be taking?

Ultimately, i aim to end up with a map where you know depending on your location, where your nearest point is, represented by area.

140
R
Q
quangig
asked in Data
How to convert DGN to DWG ?

Dear All,I need a full video tutorial to convert objects on Micrcsation v8i software to Autocad software using FME software?Someone did it, please guide me.Thank you very muchPham ngoc Quang

1750
Q
B
bigjonas69
asked in Data
Generate simple trees from Point Cloud (LIDAR)

Hello,I want to create simple mesh trees from Point Cloud (LIDAR) in FME. And the closest thing I came to was with the "PointCloudSurfaceBuilder" transformer.Can anybody help me with this, please. The file is the way I want the final trees look like (it seems like it is about 8 piece of pentagon polygons for each tree).And the file is the closest I came in FME.I attach the FME-Workbench file and the input LAS file (and it looks like this ).Best regards,Jonas

4650
caracadrian
Contributor
M
michael.prior
asked in Data
Has anyone been able to expose the windows file "Title" Property?

We are working with a legacy dataset of scanned images and are moving everything to SharePoint. We discovered these files that have all the document information stored as a title property that is lost when moving to SharePoint. We are hoping that there is a way we can rename these files with the title information using FME. I have tried to expose it using the Directory and File Pathnames reader but cannot find the attribute anywhere.

122
ebygomm
Influencer
melanied
Contributor
melaniedContributor
asked in Data
S-57 ENC Reader : bug in implementation of gdal ?

Hello,I use FME to transform data in S-57 format (the native format of our databases) into more traditional formats, in particular shapefiles. The database export is therefore in S-57 format (extension .000), with the classes and attributes present for the ENCs, but this model is enriched with additional attributes and classes. This can be done by modifying the files s57attributes.csv, s57objectclasses.csv and s57expectedinput.csv in the directory $FME_HOME/s57 (Custom Object Classes File and Custom Attributes File). These files are also useful for correctly displaying additional attributes and classes in QGis (in the directory C:\\Program Files<QGIS>\\share\\gdal). While in QGis an S-57 file with additional classes and attributes is displayed correctly, this is not the case in FME.For additional classes: some are handled correctly, others generate an error when read and you can't go further in the processing (there are also cases where the class seems to be ignored, without

1319
melanied
Contributor
jeremiah567
Contributor
jeremiah567Contributor
asked in Data
The steps to follow when extracting a feature layer from the attached screenshot polygon.

I want to extract data within the masked polygon by using FME. Can you please guide me how it should be done. Which transformer to use?

150
jeremiah567
Contributor
marwa_awad
Contributor
marwa_awadContributor
asked in Data
Hi, I'm trying to convert An AutoCAD(DWG) file to Esri Geodatabase with the labels (Annotation) to attributes. How can I do that?? and also if I have the Geodatabase schema, how can i convert these labels to the attributes?

Hi, I'm trying to convert An AutoCAD(DWG) file to Esri Geodatabase with the labels (Annotation) to attributes. How can I do that?? and also if I have the Geodatabase schema, how can i convert these labels to the attributes?

2400
marwa_awad
Contributor
K
kojinkuwahara
asked in Data
I want to convert a file with extension ".SFC" in FME. SFC does not seem to be included in the Reader's Format. Is there a possible way to deal with this?

The SFC (Scadec Feature Comment file) file is a format for Japanese specifications; it is used to store CAD data and is included in the SXF (Scadec data exchange format) format, a CAD data exchange standard.

150
K
abnan0001
Supporter
abnan0001Supporter
asked in Data
SQLite Database - Data Extraction from HTML

I have a Data collected using Survey123 but sending data has issue and it was stored in android device only , so the format will be in sqlite database.. I want to extract the data from SQLite database and im able to read and see the data but not able take it into XML Fragmentor ..May be im doing some wrong.. I have attached screenshot and workspace ..Need Guidance and advice to fix this Thank YouNeed expert advice 

828
abnan0001
Supporter
B
bbulla
asked in Data
Joining a table to a feature class, and then exporting that to ArcGIS Online.

So I have created a work space with an SQL Creator to query a table of inspections I am interested in. It seems to have the proper number of results showing, but I am not sure how to actually view the queried table in the FME interface. I also have a feature class from our SDE in the workspace as well as the table of ALL the inspections. What I want to do is only use the related features that would match to records from the SQL Creator query to export to ArcGIS Online. I also want the full inspection table to also be exported to ArcGIS Online, so that a user can click on the feature and see all related inspections (which should include the one from the SQL Creator). Hopefully that makes sense. Here is what I have so far...what do I do next??  

1050
B
jacklonsdale
Contributor
jacklonsdaleContributor
asked in Data
Esri ArcGIS Image Server Reader - 64bit or alternatives

Hi all, Trying to read in UK LiDAR composite data via a FeatureReader and spatial filtering - https://www.data.gov.uk/dataset/01b3ee39-da3f-47b6-83da-dc98e73a461f/lidar-composite-dtm-2022-1m I see there is an Esri ArcGIS Image Server Reader (https://docs.safe.com/fme/2021.1/html/FME_Desktop_Documentation/FME_ReadersWriters/arcgis_image_server/arcgis_image_server.htm) which should help facilitate this - but it is not available on 64 bit. Is there any update as to when this may be supported or a current workaround for 64bit? Thanks!Jack

1160
birgit
Influencer
arturgustowski
Participant
arturgustowskiParticipant
asked in Data
Writing cell to dgn writer

We noticed that the speed of data writing to the DGN format depends on the type of objects. If we set the cell object at the beginning the writing was fast, then at the end, the speed slowed down several times. And the question is, is it a writer's trait or an object's trait?

370
edgarbaculi
Safer

Badge Winners

Show all badges

Community Stats

31,801
Posts
120,811
Replies
39,423
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.