Skip to main content
  • EN

Data

Using readers and writers to extract and load data.

  • 6,701 Posts
  • 24,706 Replies
6701 Posts
T
treenut
asked in Data
bytea::text sqlCreator differs from Pgadmin

We store a large number of files in a Bytea type as base64 ecoded strings in our database. If i use the pgAdmin to retrieve the data as Text it works fine.If you excecute the statement below in PgAdmin you get a different result then when you run it in sqlCreator to a Postgres database.How do i setup FME to get the same results as PgAdmin?What am i missing here?select ('\\x55457344424251414141414941474e7a4b6b3535706a744957514141414873414141414b414141414d584a6c593256774c6e4a6a6343584679776d414d4252453062316744314f427650796553545642564e796f415546527133636b44476675666d416674686c33486b7335384e514d31354a6677565332764a355954304f5748486b4b704e5254704e5132677567546a427276416d7a534b414c704e495a6b4453774571727736352f393855457342416a3841464141414141674159334d71546e6d6d4f30685a414141416577414141416f414a41414141414141414141674141414141414141414446795a574e6c634335795933414b4143414141414141414145414741444956446774364b6a55415276594e43336f714e5142473967304c65696f314146515377554741414141414145414151

2
T
5 years ago
S
san
asked in Data
Gml data conversion issue.

I tried to convert a gml file to cesium 3dtiles. But the conversion didn't went well.What could be the issue.When i converted the same gml file in other software it got converted correctly.What wrong i have done in the workspace . I have attached the workspace , gml file and 3dtiles. Please help me with the issue.

1
nampreetatsafe
Safer
5 years ago
runneals
Contributor
runnealsContributor
asked in Data
ArcGIS Online/Portal Items

Has anyone else had issues reading items that aren't shared to a group, but are shared to your organization? The only items that show up when I try to read them in are groupname/servicename or username/foldername/servicename, which indicates they are in a group or the user you are using owns them. We've been using FME for over 7 years, and I'm just now noticing this (which I guess either shows how important it is or how rare it is) :P

1
runneals
Contributor
5 years ago
D
danishukani
asked in Data
Is there a way to do nearest neighbor with LiDAR data and (point) vector data?

I am a first time FME user. I want to analyse the closest LiDAR points that are to my point data (pit). I tried using NeighborFinder but I guess it does not like LiDAR data and produces a empty .shp file or .gdb file. I want my .shp or .gdb with the nearest 5 LiDAR points that are averaged to produce a z value for my point vector data (pit data). It will be very kind if someone could help me with what code I would need to produce the required result? PS: plz disregard the aerial image in the background.

12
reservoirdog
Contributor
5 years ago
I
inovacaogis
asked in Data
Problems to save the Database Connection

When I try to save a database connection. In Tools -> FME Options -> FME Database Connection. The dialog is displayed: Unable to Store Connection.Can anyone tell you why this happens?

5
xiaomengatsafe
Safer
5 years ago
alanaliberti
Contributor
alanalibertiContributor
asked in Data
Autocad Linetype generation

Hi allIn a GIS to CAD transformation, I'm trying to make all autocad linear entities with line type generation attribute = true per entity.I added a DWGStyler to my workbench with "linetype generation" property set to "continuos" for lines. However, it's not working so far.Could someone please point out what I'm missing?Many thanksAlan

1
G
5 years ago
C
christian_b
asked in Data
How to use parameters for cell range in Excel reader ?

Hi,I have to read Excel files with FME 2017 but the first column of the table can be at different position in each file.(but there are always the same number of columns)So, I'm searching a way to link the first column position to a published parameter like the screenshot attached (which doesn't work...).I can't believe that with such a powerful soft like FME we can not do this...Thank you for any help !Christian

3
C
5 years ago
S
sobanmughal
asked in Data
How to Configure SSL parameters for Presto JDBC drivers

I am trying to connect to database using Presto JDBC driver. Need to know how to define and set parameters for this driver e.g. SSL = true, SSLTrustStorePath etcjava.sql.SQLException: Authentication using username/password requires SSL to be enabled

1
ravenkopelman
Safer
5 years ago
B
brajnilam
asked in Data
update xml columns with multiple if conditions

i am trying to update xml column in oracle and getting errors which i am not able to resolve . need some help hereif the data exists there and $t/row/c178[@m=82]='USA' then only update the value or do nothing    update USER.TABLE t1set t1.xmlrecord=XMLQuery('copy $t := . modify (if fn:exists /row/c2 then replace value of node $t/row/c2 with concat("firstname",$t/row/@id) else(),if fn:exists /row/c3 then replace value of node $t/row/c3 with concat("lastname",$t/row/@id) else(),if fn:exists /row/c178[@m=83] and $t/row/c178[@m=82]='USA' then replace value of node $t/row/c178[@m=83] with ("NEW YORK") else() ,if fn:exists /row/c4 and $t/row/c178[@m=82]='USA' then replace value of node $t/row/c4 with ("Manhattan")else() ,if fn:exists /row/c5 and $t/row/c178[@m=82]='USA' then replace value of node $t/row/c5 with concat ("NY 10036, USA.",$t/row/@id) else(),)return $t'passing t1.xmlrecordreturnin

1
B
5 years ago
C
cezhang
asked in Data
Custom osm map feature config for FME server

Hi,I have a job of transforming osm to imdf with a custom osm map feature config file. When I push this job to FME server, it seems to miss that config file and fail to run the job. How do I solve this problem? Any help? Thank you very much.

3
laurawatsafe
Safer
5 years ago
G
gauripearl
asked in Data
How to execute multiple sql query statements in an SQL Creator in FME?

I am running a following script, set serveroutput on;DECLARE message varchar2(20):= 'Hello, World!'; BEGIN dbms_output.put_line(message); END;Its throwing error for set serveroutput on. If I remove that statement query runs successfully with no results returned from oracle db.

6
G
5 years ago
M
maartenwdod
asked in Data
Can we save credentials for an ArcgisOnline writer in the workbench?

Can we save credentials for an ArcgisOnline writer in the workbench? Our Final Goal is to run this workbench from an automated batch script. This runs fine but after a period of time the connection to ArcGISOnline fails and we need to reconnect manually in the workbench

9
lars_de_vries
5 years ago
C
chris2
asked in Data
Transforming ArcSDE MSSQL data to FGDB

Hi,I'm trying to create a dynamic workspace to create file geodatabase extracts of data out of ArcSDE. Ideally, I would like to make use of change detection in some form, so that data that hasn't changed doesn't get processed for no reason. Even more ideally, I'd like to query the database system tables to quickly narrow down what objects have experienced any change (I have some ideas on how to satisfy the second part, but haven't gotten to it yet).The SDE extracts in FGDB form will end up on a network share and be replicated out to the users.This article is pretty much what I want to do, I think.https://knowledge.safe.com/articles/1157/dynamic-workflow-tutorial-destination-schema-as-a.htmlI have to presume that I don't know the schema, nor the quality of the data, in an effort to make this flexible for the many SDE databases we're running this for.My workspace looks like this: Where I'm getting stuck, right now anyway, is applying the delete operation t

3
jovitaatsafe
Safer
5 years ago
harmen_kampinga
harmen_kampinga
asked in Data
Create a database with FME?

Is it possible to create a PostGIS database with FME ?

3
harmen_kampinga
5 years ago
C
cainostroza
asked in Data
How to write a TIN Surface (Reading a LAS file -> TINGenerator) to IFC valid file?

Hi Guys,I've trying to write a LAS file (Creating a TIN surface with TIN Generator) to IFC file. The final purpose is add this TIN surface to a BIM Platform. I've tried, but I dont get it. I appreciate any help. Cheers!

4
R
5 years ago
mr_fme
Enthusiast
mr_fmeEnthusiast
asked in Data
Geometry in PostGis table

I'm writing information with geometry in Postgis table. It is currently in UTM, (SA-SIR-22S), before I need reproject for EPSG 4674 (SIRGAS 2000 LL). A failure occurs: The bulk copy failed in the 'public.amb_app' table using the ':' delimiter. Error was' ERROR: new line for relation "amb_app" violates verification constraint "enforce_srid_geom"CONTEXT: COPY amb_app, line 1: "8.34: 4: 461: 0400046100001: etn.sao francisco (flavio): 010300002042120000010000008503 ... 'A fatal error has occurred. Check the log file above for details... Last row repeated 2 times ... How to solve this?

1
david_r
Influencer
5 years ago
J
jecollins
asked in Data
MDB_ADO reader: An unknown exception occurred

Hi All,I am attempting to walk an FME script (using desktop 32 bit) over a large folder of specialised access databases called gINT files (.gpj) and move the data to various CSVs. However it will terminate after several hours with "MDB_ADO reader: An unknown exception occurred", and only write several of the CSVs for the files it has read. It works for smaller sample sets, so I don't believe it is a flaw in the script.I have a copy of the log, unfortunately it is a bit large to attach. Any help appreciated.Thanks-Jack Collins

6
J
5 years ago
A
asabhinavgreats
asked in Data
Reading specific rows in excel/csv

Hi All,Hope you are doing good.I have an excel sheet containing a set of data wherein i wish to read only a specific set of rows. Test Excel.xlsxIn my case, i wish to read the data below the string (in mass percent) in row 280 from 281 to 296 with 281 as the column names. The whole table is supposed to be read below the above mentioned string. These row numbers may change with different excel sheets. So i need a generalized solution.Please help. Thanks.

4
A
5 years ago
G
gauripearl
asked in Data
How to read/display output of SQL CREATOR/EXECUTOR in FME ?

I am returning a variable string from oracle stored plsql function. Function is executed successfully in sql creator without an error. I need to know how/where to see/populate the output returned from stored function.

2
david_r
Influencer
5 years ago
atle_hoidalen
atle_hoidalen
asked in Data
Unwanted result using the pointcloudsurfacebuilder with poisson construction mode

Hi guys,I have this point cloud that I have filtered and clipped so that only vegetation areas remain. These areas I want to build a mesh of so that I can import this as a 3D-model into another software. I use the pointcloudsurfacebuilder for this purpose. Using construction mode "simple triangulation", everything works fine, a separate mesh is created for eache area of vegetation.This mesh is quite coarse so I want to use constrouction mode "poisson" instead. This creates a much smoother mesh, only problem is that it also creates a rectancular surface around the whole extents of my pointcloud thus making the mesh useless for me.Anyone here who can help me sort this issue? See attached screenshots of both results.  

8
atle_hoidalen
5 years ago
G
gerenciaitssa
asked in Data
Creating Mapinfo tables

Hi,From a vb.net program, we need to create a MI Table like MITAB. We are having problems with MITAB so we are looking for an alternative.Can you help us? Thank you.Alejandro

1
danilo_fme
Evangelist
5 years ago
bo
Contributor
boContributor
asked in Data
"Error running translation" after what appears to be a successful write to an ArcSDE feature class.

There are a plethora of discussions on the "Error running translation" error, but none seem relevant to my simple workflow, as shown in the attached image, that writes a simple point geometry to an ArcSDE layer. The error msg was misleading as the point had been successfully written.I turned on the debug log and found a "BADNEWS" error in the log - - which I was not sure of its relevancy.

4
xiaomengatsafe
Safer
5 years ago
T
till
asked in Data
saving a single polygon as dxf from an array of polygons.

Dear Users,  I am trying to save a single polygon as a dxf file with a given file name out an array of polygons. My Array is 28 rows by 350 columns, this makes 9800 polygons.  Rows are numbered +14 to -14. they are divided by a centre line, north of this line numbers are positive, south of this line numbers are negative. Columns are labelled Alphabetically, i.e.: A, B, C ... Y, Z, AA, AB, AC ... AY, AZ, BA, BB, BC and so on until ML.  My goal is to save each polygon in a separate dxf file. the name of the file should correspond with the "coordinate" within the array, i.e. "AA_+01" , "BO_-13" , "ML_+11". I am completely new to the FME environment and I ahve no idea where to start this task. I do believe that this action is relatively straight-forward for an experienced user.I am grateful for any help regarding this task.  Kind regards,Till  

1
redgeographics
Evangelist
5 years ago
D
destest
asked in Data
Building Heights from OSM map

Hi, we use Infraworks at work to bring OSM/OSNI to create quick contextual design for our sites. As of now, the heights of buildings are adjusted manually and it takes really long time applying height to each building. I was wondering is there anyway FME can extract this out?

1
redgeographics
Evangelist
5 years ago
G
gisuser
asked in Data
Writing a GBD relationship class

Hi FME Experts, I am trying to write a Geodatabase relationship class between feature class and stand-alone table but it could not be created, it gives me a below error :"Unable to create table/feature class/relationship class of type 'geodb_invalid'. Creation of this type is not currently supported by FME, and must be done through Esri toolsGeodatabaseRelationshipFeaturesPipeline::GeodatabaseRelationshipFeatures(SortFactory): A fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for detailsSome error has occurred closing the pipeline factory, see previous warningTransaction #1 rolled back. Rerun translation specifying transaction #0 for the keyword 'TRANSACTION'Some error has occurred closing the pipeline factory, see previous warningA fatal error has occurred. Check the logfile above for details" Note :I have followed the steps and recommendation points in the article https://knowledge.safe.com/art

1
fgiron
Contributor
5 years ago

Badge winners

  • Webinar Watcher (Grey)
    matt.landrumhas earned the badge Webinar Watcher (Grey)
  • Welcome Back
    lenusmarshas earned the badge Welcome Back
  • Welcome Back
    chris_rmwhas earned the badge Welcome Back
  • Integrate Spatial Data
    rwnewcshas earned the badge Integrate Spatial Data
  • Welcome Back
    joyhas earned the badge Welcome Back
Show all badges
29,729
Posts
Terms & ConditionsCookie settings