- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,818 Posts
25,113 Replies

When you subscribe we will email you when there is a new topic in this category

6818 Posts

FME 2015- extract join fields from smallworld to GeoJson format

How to extract a smallworld data i.e., join fields from a collection?

extract data from smallworld

how to include a magik script in fme while extracting data?

Reading .gdb into PostGIS is very very very slow, takes weeks

Hi,I am using a reader to read the local .gdb file (around 11 GB) and write one of the feature classes into a Postgresql table. Reading is quite slow especially after processed 100,000 features, while the writing is at normal speed and is not an issue at all. So far, it already taken me around 10 days to read and write only 400,000 features into warehouse, still not finished.I assume it is because memory shortage, so I also disabled the feature caching. Anything else I can do to speed up the work? have been stuck for 2 weeks.

Hello. I cannot seem to run any workbench invokving a WFS. It seems to workan extent where it reads the get capabilities to give me the feature list but when i try to run preview or run the workbench, i get the error "HTTP transfer error: 'Couldn't connect to server'" We work behind a proxy but i have configured this in the s, and it works fine for wms, arcgis featur services. Just not WFS. the WFS service itself is fine, i can connect via other software such as QGIS just not via FME http://geoportal.ancpi.ro/arcgis/services/AU/AU_WFS_STEREO/MapServer/WFSServer?request=GetCapabilities&service=WFS Working on desktop 2019.2 Many thanks

Excel Reader, order of columns

Hello all, this question is related to question 83147, I have the same problem. I use a generic reader and refer to the attribute values in the Excel file using the attribute dereferencer. This wiorked fine with my first tests. But now I have an Excel file which shows the columns completely at a different position than in FME!Excel: FME: The Kennung, in Excel the last column is the second column in FME. The specification to the service I provide via FME server is that the colum 1 and 2 in Excel (so 0 and 1 in FME) shall be used as X and Y. From what I see in Excel it should work but my workspace fails because the "Kennung" value is no valid coordinate. Any suggestions? I can't find a reason why FME changes the column order File is attatched:

Unable to retrieve table schemas using Oracle Non-Spatial Reader

We are unable to use the Oracle Non-Spatial reader to retrieve table schemas from the database. The error returned is as follows:Failed to obtain any schemas from reader 'ORACLE_NONSPATIAL' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more informationUnfortunately that is the log file, so there is no further information. Oddly enough, once the workspace is generated it can be run perfectly fine and read data from the oracle database without error. We have tried Oracle clients 11.2 and 12.1 with FME 2017, 2018, and 2019 and all error. The Oracle Client has been correctly installed and works great from sql developer, arcgis, and other applications. There is also a TNS_ADMIN environment variable to the TNS names file and the client path is in the PATH environment variable. Additionally we are unable to retrieve SDE feature class schemas from the oracle database using the

Writing to SQL DB with Windows Authentication off

Hi All, I have a workbench that takes an Intergraph Access Warehouse, massages it, and then writes to a Intergraph SQL Warehouse. In our environment, using windows authentication on the SQL DB, users only have permission to insert into the SQL DB. In the workbench, I have 'Use Windows Authentication' set to 'No'. I then use a specific SQL logon that has full rights to the SQL DB. When I run the translation, it fails with the following error log: Using user supplied ODBC DSN 'ELP_Maintenance' as dataset Successfully connected to source dataset 'ELP_Maintenance' GeoMedia SQL Writer: Table 'ELP_UG_URDBox' has IDENTITY column 'ELP_UG_URDBox_ID' Database error: '[Microsoft][ODBC SQL Server Driver][SQL Server]CREATE VIEW permission denied in database 'ELP_Maintenance'.' SQL is: 'CREATE VIEW "FME_VIEW_1" AS SELECT [Asset_Status], [Asset_Owner], [Asset_InstallDate], [Asset_Acquisition], [Asset_WorkOrder_Install

5 years ago

agelfertContributor

asked in Data

Unable to create a Database Connection in FME Server using Windows Authentication (for SQL Server)

Trying to make my life easier by setting up some Database connections in FME Server to help with updating workspaces, as I'm having to repoint them to a new SQL Server instance. So I'm trying to set up a named SQL Server connection using Windows Authentication. As expected, user and password fields are greyed out. But when I click on "OK", I'm prompted "PASSWORD is required". What am I doing wrong? Bug?

How to expose "Material" Data in IFC File. (IFC->IFC)

Hello, Iam looking for an Oportunity for IFC-Mapping. After working through a few Tutorials.Set other Strings in "Names or Descrition" is no Problem. Creating own Property Sets is possible too.But my Problem is the IfcMaterial Attribute/PropertySet.I got an IFC File which i can open in "Solibri" and Data "Inspector". It contained the Property layer Set "Material" and Identification Attribute "Material".After Running the blank Workspace both Attributes disappear.The AttributeExposer gives me these Opportunities but no progress here.or are the IFC-Writer settings the key? (Reprentations to Read?) I Want to write in Ifc 2x3. I hope you can give me a hint :)Thank you!Richard

Smallworld to GEoJson extract

I need to extract data from smallworld,from a collection(wire segment) I have an attribute (again a collection - Bay).I want to extract the data i.e., Id of wire, Id of Bay , Asset ID of Bay -- in the properties tag along with linestrings. Now I am trying to extract the data, but in the properties tag only the size of bay is displaying.Can someone please help me on that?

Upgrade to FME Server 2019.2.1 - Restore not working

Hi,I have upgraded FME server on our test server (on prem, Windows Server 2016, express install, default install settings), using these instructions: http://docs.safe.com/fme/html/FME_Server_Documentation/AdminGuide/Upgrade-in-Place-Same-Machine.htm I took a backup of the FME config and tested it worked, which it did on 2018.1.1.1.After upgrading the server (version 2019.2.1, Build 19813), I tried to restore the backup but then it failed.It has this error: “Could not write FME Server request message. Connection may have been lost. An existing connection was forcibly closed by the remote host”I also noticed that the FME Server Core service stops during the restore and I have to restart it manually to get the server working again. I think the service stopping is the cause of the failed restore. I have tried restoring the backup pre/post licencing the server, running the services as 'local system' or as our specific account, multiple restarts and re-installs, but still no success.

5 years ago

asked in Data

Keep only columns in a PostGis data if they are not listed in the text file

HelloI want to export a table from PostGis databse by keeping only the columns that don't appear in a text file. This is an example to be more clear : Text_file : A B C ZTable columns :ID 7 T Z F K B Export result:ID 7 T F K Thank you in advance for your answers.Best Regards

5 years ago

deanhowellEnthusiast

asked in Data

Reading and Writing Font from AutoCAD DWG

I have a DWG file that I am needing to validate and one of the tasks is to assess the font. 1. How do I find out the font or fonts used in the DWG? Secondly, once I know the original font, I want to use that same font to write out the drawing using MapnikRaster. 2. How do I set the font and font size based on what is in the original drawing?

CSV Reader skips duplicate file name

Hi, good FME people!First post here, let's see if we can solve this.I am using a CSV reader to read all the files within a folder. [...\\rawdata\\*}], regardless of file extension.In the reader parmeter menu I am using the standard dataset parameter, feature type name from file name. I am noticing that not all files are getting through the reader. And by checking all unique fme_feature_types against what is actually in the folder it seems that duplicate filenames a skipped. The problem might be that there are duplicate file names, but in windows explorer, they are not considered duplicates as they have different extensions. Ie "1204NA.SND" and 1204NA.cpt"Is there a good solution for this? Thank you in advanceVictor

5 years ago

alamberthampton

asked in Data

Salesforce Reader: Can a soql Select statement include Relational object like Parcel__r.Streetname

The query below works in Dataloader and the Pentaho Kettle tool. But the Salesforce reader ignores the Parcel__r.xx fields. I see where @schatt15 posted here saying he used Dataloader in his SF Reader. But I don't see any option like that in SF reader. I'm using FME Workbench in ESRI 10.7 FME(R) 2019.0.0.0 (20190328 - Build 19238 - WIN32)Thanks for your time.AllanSelect Parcel__r.MUSW__Street_Number__c,Parcel__r.MUSW__Street__c, Parcel__r.MUSW__City__c,Parcel__r.MUSW__State__c,Parcel__r.MUSW__Post_Zip_Code__c,CreatedDate,NAME,Ordinance__c,MUSW__Status__c, MUSW__Corrected_Date__c,GRASS_SQ_FT__C,Age__c,Code_Enforcement_Area__c,Safe_Clean__cFROM MUSW__Violation__cWHERE CreatedDate = LAST_N_DAYS:100

5 years ago

borko_k

asked in Data

Error with Path Reader - Automation in FME Server

I have a problem with Path Reader in FME Server during Automations. I am quite new in FME Server, so maybe this issue is very easy.I would like to build automation with Directory Watch as Trigger - if file is creating or modyfing Workspace will run. Path to watch: $(FME_SHAREDRESOURCE_DATA)/Input.First part of my script, created in FME Desktop, depends on moving and archiving old data from $(FME_SHAREDRESOURCE_DATA)/Output to $(FME_SHAREDRESOURCE_DATA)/Archive. I built script in FME Workbench, wherein the Reader is PATH, and the Writer is file_copy.When I run this script with using Run Workspace in FME Server, everything is correct, old data are moved and new data are transformed and saved in FME Server Resources.But when I try to run it with Automation, something is wrong and in the log I can find the information:79Path Reader: Error opening the PATH Reader on folder 'Server\\resources\\data\\Output'. Could not find folder.80MULTI_READER(PATH_1): Skipping to next Reader81A fat

Hi!,Can somebody tell me why I'm having a writing problem with GML? I have noticed that they are the only one having the property : Arc by centre pointAny clue to solve this problem? Thanks.

5 years ago

deanhowellEnthusiast

asked in Data

DWG to TIFF

Is there a way to take the data that is in an AutoCAD DWG paperspace and output it to TIFF / GeoTIFF keeping all the drawing settings from the DWG i.e. fonts, line weights etc. Basically I want to get an image that would be the same as if the DWG was printed from AutoCAD.

AutoCAD DWG/DXF read as merged featuretyps and write as single featuretype

Hi, I have different DXF File with a lot of layers. I read them with the AutoCad DWG/DXF reader, filter and editing them. For the better handling I read the files as merged featuretypes, but I need at the end the data with single featuretype. That means I need all layers from the file and not the merged.How can I manage this with the Autocad DWG/DXF writer? Thanks and best regard

5 years ago

aquerisoft

asked in Data

Reding GDB field aliases in Arabic

Greetings,I am writing a workbench in which I am supposed to read from an Arc SDE(oracle) database and writing all the contents in a File GDB. All the attribute names have their aliases in arabic which I need to replicate in the FGDB.I have checked the alias mode of the SDE reader to "Expose Aliases as Metadata" and the reader reads it but somehow it is corrupting the aliases in the output file GDB. Can anybody please help me getting through this. Regards,IMRAN

5 years ago

mark2atsafeSafer

asked in Data

Excessive request

Thanks for the heads up on that one question, @redgeographics - I think you're right. It's too much to expect anyone to answer with that much content. We'll see how they respond and we can keep an eye out for if they ask that sort of question too often (if they do we'll usually pass it on to their sales contact at Safe to suggest training or paying for consulting with one of our partners)

5 years ago

lifalin2016Contributor

asked in Data

Can FME make offline maps for ArcGIS Explorer ?

Hi.We're looking into producing some custom maps for offline usage on an iPad, and is looking at using the ArcGIS Explorer app for this.We do have access to ArcGIS Desktop, and to ArcGIS Online, but I would very much like to use FME to generate the map content.I've already uploaded custom map data to ArcGIS Online with FME, but maps for offline use require some "map package" (MMPK) files to be created and uploaded.Is this doable ? Has anyone attempted such a task with success ?Cheers

540

5 years ago

souryanaContributor

asked in Data

My KMLtourbuilder is "jumping" through the whole tour in Google earth

Hi,I am trying to build a KMLtour in FME so I can use it in Google earth. However, it is not working as I wish it did. First of all, from 3rd perspective it moves with a blink of an eye to the start position. I would like it to smoothly move to the start position. And secondly, it is "jumping" up and down, back and forth throughout the whole tour. What I really would like the KMLtourbuilder to create is to run it smoothly from start position to end position.Can someone please help me with this task? I will attach all my work in a zipfile and also the kml tour builder that may be open through google earth.

Writing Spatialite error

This is what I get when I write to a Spatialite database...: I don't know what's going on.Well it says there is no geometry mapping, but how is that? No geometry mapping entry found for 'fme_varchar(200)' in metafile 'C:\\Program Files\\FME2019\\metafile\\SPATIALITE.fmf'. Please visit http://www.safe.com/supportWorker 11036 > No geometry mapping entry found for 'fme_varchar(200)' in metafile 'C:\\Program Files\\FME2019\\metafile\\SPATIALITE.fmf'. Please visit http://www.safe.com/support

I have a obj file (200MB) and want to convert to cesium 3D tile with LOD.

I have a obj file (200MB) and want to convert to cesium 3D tile. The FME converter is just change the format but i would like to apply LOD for the final 3D tile. is there any options in FME to provide tis function?

610

5 years ago

Page 94 / 273

Badge winners

judithhas earned the badge FME Certified Trainer
lundg1has earned the badge Integrate Data with the FME Platform Training
bezearvhas earned the badge English Speaker
bezearvhas earned the badge French Speaker
bezearvhas earned the badge German Speaker

Show all badges

30,410: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.