Skip to main content
  • EN

Data

Using readers and writers to extract and load data.

  • 6,812 Posts
  • 25,090 Replies
6812 Posts
gogopotter90
Contributor
gogopotter90Contributor
asked in Data
could i get intersection between lines and points in oracle files ,spatial and not spatial

could i get intersection between lines and points in oracle files one of them is spatial and another oracl not spatial just i do not want to load all oracle files in spatial and it will make the workspace slow so i was thinking to to import one spatial oracle file and another not .spatial .is it possible to find intersection between both of them or should i load all oracle files only in spatial .Thanks

110
gogopotter90
Contributor
4 years ago
jackyd
Contributor
jackydContributor
asked in Data
Trouble Connecting to ArcGIS Server Service

I cannot connect to an ArcGIS Server Feature Service though either a reader connection or a feature reader.The service I am trying to connect to is:https://services.thelist.tas.gov.au/arcgis/rest/servicesI have not problems connecting and accessing the data through ArcProI am using FME 2019.1.0.0 (20190710 - Build 19608 - WIN 64) with and Oracle Floating LicenceAnd also have FME 2015 installed, which i need to keep until we have updated some legacy processes. There is probably something very simply I am missing but for the life of can't see it. Below is the translation log from when I try to connect to the service with an ESRI ArcGIS Server Feature Service Reader ( I have highlighted the errors in Bold): Starting translation...FME 2019.1.0.0 (20190710 - Build 19608 - WIN64)FME Desktop Oracle Edition (floating)Permanent License.Machine host name is: TN4405Operating System: Microsoft Windows 10 64-bit (Build 18362)Copyright (c) 1994 - 2019, Safe Software Inc.Safe Software Inc.2020-03

1310
debbiatsafe
Safer
4 years ago
raaaju1990
Contributor
raaaju1990Contributor
asked in Data
'ERROR: null value in column "objectid" violates not-null constraint - postgres/ArcSDE

Hi,I have an ArcSDE geodatabase on postgres. Im using a feature writer to insert records in an existing feature class.While doing so, I get the below error 'ERROR: null value in column "objectid" violates not-null constraint'When I drop the table and create new while writing, I get no errors.Logically, the sde should autogenerate this objectid field whenever I insert a new record. Am I right or where am I going wrong?Please suggestThanks

1700
david_r
Evangelist
4 years ago
T
telcoengsuper
asked in Data
DWG to Shape File workspace needed

I need a workspace that will convert DWG to SHP. I get DWG files all the time and my Mapping software imports shape files. So I need shp files rather than DWG all ineed is the lines in the DWG not so much any data. I need help. I've tried different things with bad results.

60
T
4 years ago
A
adam_6780
asked in Data
Best reader and writer settings for Autocad?

Hi,I'm re-projecting some 3D AutoCAD drawings. After converting them the filesize goes from 4mb to around 40mb, this is using the deault settings for the reader and writer, so not sure why they have increased in size with re-projecting the data from snakegrid to OSGB.What are the best read and write settings when reading and writing AutoCAD files?Adam

50
A
4 years ago
lifalin2016
Contributor
lifalin2016Contributor
asked in Data
Generate GML for a single feature ?

Hi list.I'm tasked with creating an XML, that is compromised from many different sources (database tables/views). I'm plannning to use a number of XmlTemplater's to accomplish this.But each feature from some of these sources is represented in the final XML as a bit of GML wrapped in special tags.FeatureWriter will collect all input features into a single GML file. This is not what I want.Is there a way to make FME output the GML representation for each feature ?Cheers.Lars I.

100
lifalin2016
Contributor
4 years ago
helmoet
helmoet
asked in Data
Value of FME_SERVER_WEB_URL deviant?

Hi, I am trying to generate a simple HTML page on FME Server 2017 to start an FME Server Jobsubmitter Job. I use an HTML template where I replace the server part of the URL by $(FME_SERVER_WEB_URL). We are on a secure environment and the FME Server is on URL https://myfmeserver.mycomp.nl:443/fmeserver. But when I use the FME_SERVER_WEB_URL parameter, it returns the insecure version of it: http://myfmeserver.mycomp.nl:80/fmeserver. The service URLs are configured for SSL, i.e., starting with https://. How does FME Engine "know" about its URL? What is the source of the $(FME_SERVER_WEB_URL) parameter? Thanks in advance.

430
helmoet
4 years ago
R
rowantree
asked in Data
Creating a KML file from a JPG- missing data

I have a jpg of a historical map (with no accompanying data) that I'm trying to write data for to upload into google maps as a KML file. I know the coordinates of the map, so I started with the RasterGeoreferencer to assign the correct coordinates. The problem is that none of the data that I want to create/ add to the file (for example, a z coordinate with the 3d forcer) shows up. There is a coordinate system assigned, and I can find the coordinates of any point I click on in the graphics window, but the data doesn't seem to be stored in any category.This returns missing data for everything except for the source name...How would I properly write data for my map so that I can turn it into a workable KML file?

150
A
4 years ago
J
jonathanklarup
asked in Data
Joining GDB with GML and writing to GML -> missing geometry in output gml

When joining file-GDB dataset with GML dataset and then writing to GML the geometry is missing in the output, if I dont join with the GDB the geometry is in the output. Is there some hidden GDB features which causes this ?  Or what is happening ?

60
J
4 years ago
H
holmgrenca
asked in Data
Writing jpgs to projectwise with PW Connector

I'm trying to write jpgs that are created from a blob directly to a folder in ProjectWise. I'm a newbie at this so maybe I'm just missing a step? Works fine when writing to C:\\Temp with JPEG Writer

60
chrisatsafe
Contributor
4 years ago
fmelizard
Contributor
fmelizardContributor
asked in Data
FME World Tour 2020 Update - Please Read!

Due to the COVID-19 outbreak, we are cancelling the Safe-hosted FME World Tour events this year. We are working to bring them online and will be providing details shortly.Our team here at Safe Software has been closely monitoring the evolving COVID-19 situation. After taking the guidance and recommended safety measures issued by the World Health Organization and health authorities into consideration, we have made the difficult decision to suspend all in-person Safe-hosted World Tour events through to the end of April 2020. During this time we want everyone: our team, our partners, and our customers to look after yourselves and those you care about.While we will most certainly miss seeing you all in person, we plan to share the latest updates in FME 2020, along with time-saving tips and best practices you can apply to your work, during our virtual event. More details about this will be provided soon. Stay updated with the latest news by signing up for email updates below.   For more inf

80
warrendev
Enthusiast
4 years ago
R
robert.li
asked in Data
Cesium 3d tiles (b3dm) exported from Collada have render problem in Cesium.

Hi, I wanted to make Cesium 3d tiles in FME.My source model is textured collada (open collada from 3dsmax).Fme is producing 3d tile files, but in cesium i have problems rendering them.it gave me errors like so:when i'm creating cesium3d tile file in FME with .OBJ source model its just fine (besides materials):but the goal for me is to produce 3d tile from collada wich i believe would give better anti-aliasing/mipmap result in cesium, what is main problem(as seen on screen above).1. Does anyone knows how to export proper Cesium 3d tile (b3dm) using Collada as reader?2. Does anyknow knows how to get proper antialiasing/mipmapping settings in cesium with 3d tiles(b3dm) using OBJ/DAE as reader in fme?Thank you in advance!

530
A
4 years ago
D
djcad
asked in Data
SHP TO SQLITE Spatial Very Slow

have a few shape files that I'm merging together using multiple transformers including LineOnLineOverlayer and Line Combiner and writing to SQLITE Spatial format. The file processing takes a few minutes but the SQLite Spatial writer takes up to half an hour to write 130,000 line features. It must find something disagreeable with the processed features that is over my head. Once the features are in SQLite format, and doing any additional processing, the SQLITE writer has no more issues. I have tried it figuring this out from all angles, but its time to reach out to the pros. I have attached a sample line feature right before and after SQLite Writer. If you need more details let me know.Thanks in Advance.I

260
M
4 years ago
souryana
Contributor
souryanaContributor
asked in Data
The FME script is deleteing my manually added attributes in writer SQL table, how do I keep them?

Hi,I have a script where I read from a table, lets call it A, to another table, lets call it B. In table B I have added a number of columns (and attributes in those columns) that doesn't exist in table A. This script needs to be automated. However, what happens is that it deletes the attributes that I added manually. I dont want that to happen. What I want for table B to do is:1. ONLY update columns that derives from table A. 2. DO NOT delete attributes that only exist in table BHow should I proceed with this issue?

60
M
4 years ago
A
arctic
asked in Data
Getting world file from JPG & CSV files

I have some aerial images that need geotagging from a CSV file. I'd also like to get the world file for each image. I'm new to FME and have tried to read docs/forums on how to solve this problem but am stuck. Appreciate any tips/how to's. Thanks

390
A
4 years ago
durshe80
durshe80
asked in Data
Forgot admin password; is there a way to reset it?

After upgrading to FME 2020, I went ahead and changed my password. I entered it into my password keeper, copied it from there into FME, and confirmed the change. However, that password didn't stick in my password keeper. So I am unable to login to FME web interface. Is there a way to reset the password?

410
durshe80
4 years ago
J
jonbird
asked in Data
Deleting files spatially

Hi. I'm looking for a way for FME to check a folder full of GMLs and either delete the ones that don't fall within a shapefile area feature, or move those that do to a different folder, but I assume the first option is easier ... but I could be wrong. So for instance if I had a GML location for each Corona virus case in a folder, I want it to delete those GMLs that fall outside of my shapefile of the UK. Any ideas? Do it for the children - and the elderly! J

160
mark2atsafe
Safer
4 years ago
F
fluusha
asked in Data
Excel properties

 if i rightclick on my excel and look at the Properties i need that date.How can i extract that date so i can work with it?(Origin --> Last save)

247
daraghatsafe
4 years ago
M
martintodoroski
asked in Data
How to overcome unexpected input during ifc to citygml conversion?

I am trying to make a CityGML file from IFC using a slightly modified workbench provided in one of the tutorials for IFC to CityGML conversion. After running the workbench i end up with unexpected input window.

50
M
4 years ago
M
mk_gdic
asked in Data
Loop through multiple log files and extract information

Hi there - We'd like to create a workspace document that searches for log files in a series of folders (most are FME logfiles, but not all), then searches through each log file for errors, run length, etc., then update an SDE table with this information, and send some email notification on failures.I've got no problem with adding a data reader to search for and find the log files. However, after that, is there a transformer I can use to search through each file and extract the information? Or do I need to do the search/extract via a python caller?Thanks. M. Knapp 

230
redgeographics
Celebrity
4 years ago
nicholas
Contributor
nicholasContributor
asked in Data
ECW writer compression

I am transitioning from using ERDAS Imagine to FME to generate ECW filesI need to understand the difference between the terminology used by both systems with regards to compression.FME ECW writer refers to "Compress by Percentage (0-99)" with a default of 75this means that the output image will be 75% compressed, or one-quarter the sizeERDAS Imagine refers to "Target ECW Compression" with a default of 20this means that the output image will be compressed by a ratio of 20:1, or one-twentieth the size.Two questions;1) Why does FME use a compression percentage and not a compression ratio (the convention established by ERDAS)2) Why is FME's default compression different to ERDAS's default compression?

750
jovitaatsafe
Safer
4 years ago
eric_armitage
Contributor
eric_armitageContributor
asked in Data
Problem converting DWG to Geodatabase

I have a DWG file with simple 3D shapes of buildings for a town, I need to convert it to Geodatabase so I can import to CityEngine. I can inspect it ok. I have tried various ways to convet it but nothing seems to work. In particular, when I attach a gdb writer there is no option to output a surface geometry (see screenshot). I also tried the auto generate workspace but that output an empty file. Any idea what im doing wrong?

170
eric_armitage
Contributor
4 years ago
W
wendyamymnc
asked in Data
I am searching for a approach to convert Bentley DGN complex shapes (without curve elements) into simple shapes

My input data is DGN with complex shapes created orginally from lines. I would like to convert the complex shapes to simple shapes

90
W
4 years ago
mhab
Contributor
mhabContributor
asked in Data
Writing CityJSON: what is going wrong ?

I did some easy tests on reading CityJSON and writing out the same data I just read in.Reading was easy. Problems start when I try to write the data I just read in.I always get some error ffs with Feature types I don't understand and I don't know where they come from: The CityJSON file which is written cannot be read in again as a CityJSON fileCITYJSON reader: An error occurred. FME will attempt to provide more information on the error, but this may cause the translation to be terminatedRead Metadata Feature Command caught exception: stk::ex::FatalError[0] CITYJSON reader: [json.exception.out_of_range.403] key 'boundaries' not found[1] auto __cdecl STFReader::getFeature::<lambda_e8ad0c4de285582507d80bbbf97fb805>::operator ()(void) const(C:\\code\\fme\\foundation\\framework\\engine\\reader.cpp:61) It is a tech preview, OK and I managed to write CityGML successfully.Any guideline how to do this properly for CityJSON ?Michael   

520
mhab
Contributor
4 years ago
pirwin
pirwin
asked in Data
Field Name has a * suffix, but values are not been read in FME 2020

Hi,Since I've updated my FME Desktop to the 2020 version the values when my field name is suffixed with a * aren't been read into FME. I know FME changes the * to _ when it is loaded in Desktop, but this wasn't an issue before.For example, below is a screenshot of my Excel file.And this is how FME deals with it.You can see the values in Your Name* doesn't get read.As I say this wasn't an issue in previous versions. Is there something new I should be aware of?RegardsPaul

60
M
4 years ago

Badge winners

Show all badges
30,378
Posts
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.