- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,779 Posts
24,932 Replies

When you subscribe we will email you when there is a new topic in this category

6779 Posts

Recently active

Most replies Most views Newest first

jaygrg111_Contributor

asked in Data

Can Geospatial PDF Reader Transformer read pdf maps as pdf maps (no spatial feature or table) from SharePoint and publish it as PDF on ArcGISOnline?

I want to be able to read a list of PDFs from SharePoint and publish them on AGOL as PDF.

In QGIS I can open Google Street View coverage using this URL as XYZ tile:https://mts2.google.com/mapslt?lyrs%3Dsvv%26x%3D{x}%26y%3D{y}%26z%3D{z}%26w%3D256%26h%3D256%26hl%3Den&style%3D40,18 The result is following: I can't get it to read into FME Desktop. Any suggestions?

kellerContributor

This may be a little simple but it seems not to work for me, I have a workspace that reads a .csv file and runs a process. Ideally i would like to move this csv file once the process is complete and rename it by date. What i have tried so far,After the reader i created a junction and I put one process to run through the whole workspace and another arrow i put to a DateTime stamper, DateTimeConverter and created the attributes filecopy_source_dataset, filecopy_dest_dataset and filecopy_dest_filename, (based on several tutorials i have been reading.) I then use the filecopy writer to move the file. The file gets moved but the name is not changed and i get a warning that --> Ignoring the destination filename .. because the source dataset...was not a file. Destination file names are only used when the source dataset is a file. For some reason the exact name i did set (@Value(Datum)_@Value(filecopy_dest_filename)) is shown in the written summary but not on the folder, anyone with an ide

222

1 year ago

fmelizardContributor

asked in Data

Maximo Connector - what do you want it do?

Hi All,We are currently working on Maximo connector transformer(s), and have been successful in connecting and querying a Maximo database. However, there is an incredible amount of functionality available through the APIs, and I would like to initially concentrate on what is most useful to our users.So I am requesting your feedback on how you would like to use FME with Maximo. Do you want to add Assets or Work Orders? Do you want link Maximo info to your GIS or BIM data. Do you want to do complex queries? This is a chance for you to shape the design of a new series of transformers.Detailed uses cases would be greatly appreciated.

Struggling to open JP2 files in FME workbench 2022.2, Build 22789 - WIN64. Anyone else having this problem?

Hi, I'm using FME workbench 2022.2, Build 22789 - WIN64. I'm trying to process several thousand JP2 files.I'm finding that trying to open just one JP2 file (~1.5GB) in the inspector doesn't seem to work ... by that I mean I stop the process after waiting about 30 minutes. Thanks in advance for help!

108

1 year ago

kimoContributor

asked in Data

Create a primary integer autoincrement key in sqlite

I can set an index on an integer or even a unique index, but there is no type for a primary key or autoincrement. How can I specify this? I could do this with an SQL Create expression. Can I use SQL to create a schema?I am adding a changeset with new records using insert but I need an OID column for ArcGIS to be able to use the table/featureclass separate from the real ID.

1102

1 year ago

freddy17Contributor

asked in Data

Sun Analysis Tools in FME?

I was just wondering if anyone has done sunlight / shading analysis in FME? In Rhino 3d + Grasshopper, Ladybug and Honeybee are plugins that can do this. Below a few images. I know that one can do some interesting stuff with the surface footprint replacer, and change the angles, and thereby create shadows. But thought I would ask before diving deeper. Maybe another option would be to go the ESRI route. Ladybug:Ladybug Tools | Food4Rhino CheersFred

1163

1 year ago

sameerContributor

asked in Data

Attribute Manager (Import Wizard) - Possible Bug as Attributes are sorted by default

FME(R) 2022.2.5.0 (20230329 - Build 22795 - WIN64 Hello Just detected this possible bug when importing Attribute Names / Values using Attribute Manager. The Names are pre-sorted and the "Sorted" option unticked as shown below. Once the dataset has been imported (Select * for Input/Output/Values) the values are set as shown below. Was I not meant to see the actual values or have I misunderstood this part? Looks like the Attribute Names have been set as values. If that's intended then what could be a potential use case? Original Attribute Names order / Table structure as defined in the Postgis Db ThanksSameer

121

1 year ago

tvaContributor

asked in Data

FME Form (desktop) best practices and style

Hi,I was wondering if there are some best practices and or style guides / examples on for workspaces. Some questions that I have about this (besides the obvious: avoid crossing as much as possible, annotation, clear transformer names etc) Like is there an agreed style for public and private parameters (casing, under scores, ...)Is there an advise on how many transformers can be put in the main part and how many in a custom transformer?How many custom transformers can be nested into each other or is it advised to not do this to deep (performance impact)Any other good to implement styles?

FME Sharepoint List Reader issue - returns error 401 when clicking on "Lists"

Hi,I have been investigating this for some time, but did not find any solution so far: In order to read sharepoint lists from a predefined sharepoint site, I used the web connection "Microsoft SharePoint Online (Template)". As testing / reauthentication was successful, I felt ready to read a list from this specific sharepoint page so I inserted its URL and indicated my web connection. However, when I click on "Lists" to retrieve the lists I created, I get an error message (see attached). The error in the log furthermore shows:"Failed to obtain any schemas from reader 'SHAREPOINT' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information" I am using FME 2020.2. Do you know what I am missing here?

1998

1 year ago

jsdbroughtonParticipant

asked in Data

CRITICAL: Both DGN and DWG readers fail reporting ACAD2004

In both 2022.2.5 and 2023.0.0, I am unable to read DWG files or DGN files. The translation log reads:DWGAutoCAD Reader: An error occurred for dataset 'xxx.dwg', in function AutoCAD2004Reader::open. Exception thrown: 'Extended error' (The file cannot be accessed by the system. SCENEOE_23.9fme_17.tx) Failed to obtain any schemas from reader 'ACAD' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information Translation FAILED.Error running translation.Workspace generation failed. Parameter file was C:\Users\JSDBRO~1\AppData\Local\Temp\FME_1683040838597_37964.DGNFME API version of module 'acad/ACAD' matches current internal version (4.0 20220615) AutoCAD Reader: An error occurred for dataset 'xxx.dgn', in function AutoCAD2004Reader::open. Exception thrown: 'Extended error' (The file cannot be accessed by the system. SCENEOE_23.4fme_16.tx) Translation was SUCCESSFULError running tran

280

1 year ago

dor1411993Contributor

asked in Data

PDF writer in Hebrew

HiI have some wired issueI use the PDFPageFormatter to insert to a template PDF all sort of data, some of it in Hebrew and are numbers.I notice that when I insert a Hebrew Characters, It didn't appear on the PDF.Can someone please help me?Thanks!

I am running a workspace converting DGNs to gdb with no errors but it gets to this message: "FME API version of module 'GEODATABASE_FILE' matches current internal version (3.8 20190621)" and does not proceed anymore any ideas?

101

1 year ago

lifalin2016Contributor

asked in Data

FeatureWriter and "overwrite file" setting ?

Hi.I'm having trouble with a workspace, that outputs a number of GeoTIFF files to a folder.I'm using a FeatureWriter to output the GeoTIFF's. The FW has no option whether to overwrite existing files.When I save the workspace as a mapping file, and run fme.exe with this mapping file, no files gets overwritten, i.e. older versions remain in the output folder.If I run it manually (i.e. the workspace in Workbench), it seems like files are getting overwritten.Is this the WAD behaviour, or is there a difference between running *.fme and *.fmw files ?How come there isn't a setting in FeatureWriter to control this ? Or is there, somewhere hidden ?Cheers.

Write to remote MySQL database through ssh

I am able to write to a local MySQL database, but I would like to write to a remote MySQL database through an ssh connection. I don't see that the Add Database Connection interface allows this. Is there a way to do this?

Trying to create a point feature class from an excel file with lat/long coordinates. Getting a "missing column" error. How to I resolve this?

I have an excel file with lat/long coordinates and I'm trying to create points based on them in a file geodatabase. The geometry is being created but I keep getting an error when trying to view the attribute table: "A column was specified that does not exist." I've checked that all the columns are green in the file gdb writer.If I replace the file geodatabase writer with a shapefile writer everything works fine. Can anybody tell me how to figure out what is going on? Using FME Workbench (Form now?) 2020.1 Thanks, Mike

Hi all!I would like to write my data to a format called .geo which is used in Sweden but is not supported by FME.I attach some sample how the format looks like:FileHeader "SBG Object Text v2.01","Coordinate Document","UTF-8"begin FileInfo "Application","Geo Professional" FileInfo "SerialNo","123456789" FileInfo "Author","Abcdefghijklmnopqrstuvwxyz" FileInfo "Company","Abcdefghijklmnopqrstuvwxyz" FileInfo "Description", FileInfo "Coordinate System","Sweref 99 18 00 / RH2000"endPointListbegin Point "123456",6580210.000,155715.000,,,,"rör i mark med däcksel" Point ..... Point....endLineListAttributeList I have a list with points and want to fill in the list in the "pointlist" section.Would this be possible with FME right now?Any ideas or help is appreciated.

200

1 year ago

fikusasContributor

asked in Data

Assigning values to points on the network

I have to assign line IDs to bus stops (point on the line). All lines are splitted at junctions. Desired result: S1 IDs: 001, 002 (but not 025)S2 IDs: 003M1: 015, 016 (but not 031)M2: 017 Any thoughts?

1 year ago

robyn_studts

asked in Data

Smallworld points to Microstation V8i cells are different sizes

I am translating a group of point objects at different rotations from Smallworld to Microstation V8i. The same object in Smallworld and using the same FME translator. The resulting DGN has different size cells to represent the same object. The point objects that are at 0, 90, 180 or 270 are the correct size when translated but other angles translate larger. I am open to any ideas on why this is happening and what can be done about it. Thanks

If i have an outline of the UK and coordinates dotted around the UK represented as points, is it possible to create polygons which 'colour in' the UK based on the closest point? and if so, what approach should I be taking?

Ultimately, i aim to end up with a map where you know depending on your location, where your nearest point is, represented by area.

How to convert DGN to DWG ?

Dear All,I need a full video tutorial to convert objects on Micrcsation v8i software to Autocad software using FME software?Someone did it, please guide me.Thank you very muchPham ngoc Quang

Generate simple trees from Point Cloud (LIDAR)

Hello,I want to create simple mesh trees from Point Cloud (LIDAR) in FME. And the closest thing I came to was with the "PointCloudSurfaceBuilder" transformer.Can anybody help me with this, please. The file is the way I want the final trees look like (it seems like it is about 8 piece of pentagon polygons for each tree).And the file is the closest I came in FME.I attach the FME-Workbench file and the input LAS file (and it looks like this ).Best regards,Jonas

Has anyone been able to expose the windows file "Title" Property?

We are working with a legacy dataset of scanned images and are moving everything to SharePoint. We discovered these files that have all the document information stored as a title property that is lost when moving to SharePoint. We are hoping that there is a way we can rename these files with the title information using FME. I have tried to expose it using the Directory and File Pathnames reader but cannot find the attribute anywhere.

1 year ago

melanied

asked in Data

S-57 ENC Reader : bug in implementation of gdal ?

Hello,I use FME to transform data in S-57 format (the native format of our databases) into more traditional formats, in particular shapefiles. The database export is therefore in S-57 format (extension .000), with the classes and attributes present for the ENCs, but this model is enriched with additional attributes and classes. This can be done by modifying the files s57attributes.csv, s57objectclasses.csv and s57expectedinput.csv in the directory $FME_HOME/s57 (Custom Object Classes File and Custom Attributes File). These files are also useful for correctly displaying additional attributes and classes in QGis (in the directory C:\\Program Files<QGIS>\\share\\gdal). While in QGis an S-57 file with additional classes and attributes is displayed correctly, this is not the case in FME.For additional classes: some are handled correctly, others generate an error when read and you can't go further in the processing (there are also cases where the class seems to be ignored, without

The steps to follow when extracting a feature layer from the attached screenshot polygon.

I want to extract data within the masked polygon by using FME. Can you please guide me how it should be done. Which transformer to use?

1 year ago

Page 29 / 272

Badge winners

hrizzhas earned the badge Student (Grey)
hrizzhas earned the badge Teacher (Grey)
yansahas earned the badge Welcome Back
alaaaldayyathas earned the badge FME Form Basic Training
majed_abdallahas earned the badge Integrate Data with the FME Platform Training

Show all badges

30,126: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.