Skip to main content
  • EN

Data

Using readers and writers to extract and load data.

  • 6,779 Posts
  • 24,925 Replies
6779 Posts
oliver.morris
Contributor
oliver.morrisContributor
asked in Data
SQL Server JDBC writing error

Hi,Has anyone had an error when writing to sql server from FME Cloud, when I run locally it runs fine. Transferring input attributes onto output feature, this may take several minutes...COM.safe.fme.jdbc.TranslationFailureException: com.microsoft.sqlserver.jdbc.SQLServerException: com.microsoft.sqlserver.jdbc.SQLServerException: SQL Server did not return a response. The connection has been closed.COM.safe.fme.jdbc.TranslationFailureException: com.microsoft.sqlserver.jdbc.SQLServerException: com.microsoft.sqlserver.jdbc.SQLServerException: SQL Server did not return a response. The connection has been closed.Destination Feature Type Routing Correlator(RoutingFactory): COM.safe.fme.jdbc.TranslationFailureException: com.microsoft.sqlserver.jdbc.SQLServerException: com.microsoft.sqlserver.jdbc.SQLServerException: SQL Server did not return a response. The connection has been closed.COM.safe.fme.jdbc.TranslationFailureException: com.microsoft.sqlserver.jdbc.SQLServerException: com.microsoft.s

6313
oliver.morris
Contributor
6 years ago
venu
Contributor
venuContributor
asked in Data
Relationship feature class creation for Polygon featureclass with Table error?

I have file geodatabase which contains polygon featureclass and Table with unique ID and common field. While creating relationship class in fme the following error is coming... Error :-------------------------------------------------------------------------------------------------------------------------------- Unable to create table/feature class/relationship class of type 'geodb_invalid'. Creation of this type is not currently supported by FME, and must be done through Esri toolsGeodatabaseRelationshipFeaturesPipeline::GeodatabaseRelationshipFeatures(SortFactory): A fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for detailsSome error has occurred closing the pipeline factory, see previous warningNone of the edits made during the edit session were savedSome error has occurred closing the pipeline factory, see previous warningSome error has occurred closing the pipeline factory, see previous warningAbnormal termi

142
bhanu_vd
6 years ago
A
andypcatbcc
asked in Data
HELP: Detecting aggregate features and setting writer type

Please help, at a complete loose end. I have a process that's copying data from one SDE database to another. So far it's working almost okay. My main problem is a featureclass which uses multipoint geometry, and I'm dynamically setting the geometry on the writer (intended as this process will be a child workspace run against different datasources). The only way I could initially get it to work was to tell it to set the geometry based on the first feature, but I have one dataset that has 4-5 multipoint features towards the end of the dataset, so the process bombs out trying to put an aggregate into a simple feature type.

498
davideagle
Contributor
6 years ago
F
frazucca1
asked in Data
Complex KML: how convert them to vector formats?

Hi at all,at https://sentinel.esa.int/web/sentinel/missions/sentinel-2/data-products you may download Sentinel-2 tiling grid in kml format (Sentinel-2 tiling grid kml) (nearly 100 Mb). I tried to export it to SpatialLite and Shape polygons in order to work with inside a GIS more easily.But till now, I haven't success to export geometry Placemark (no polygon nor lines).By inspection them inside FME DATA Inspector, I see a complex structure --> IFMEAggregate made up by polygons and points. What I'm looking for!! But sure due to my illiteracy I can't find a manner to explode and extract and I just get or error on output or strange void features.Any hints?Best,fz

312
jdh
Contributor
6 years ago
K
kat
asked in Data
Use color ramp for pdf output

Good day, I have a position (coordinates) for each day of a month. I would like to display them on a map with a color ramp. e.g. Light yellow for the first day of the month and then getting darker with each day. The output should be a pdf. The pdf styler has no color ramp option and I couldn't get GradedColorizer working properly. Any other solution available?

141
davideagle
Contributor
6 years ago
soothsayers
Contributor
soothsayersContributor
asked in Data
Writing to a GDB using a UUID or Timestamp

I would like to create a folder for output that is named by either a UUID or Timestamp. Within that folder I want to output multiple feature classes within one geodatabase, plus add other items such as layer files loose into that folder.So for example it might look this this:UUIDFolder/ (containing loose lyr files etc.)PLUSUUIDFolder/export.gdb (containing multiple features classes)The problems I'm facing are as follows:- I can create a parameter for UUID/Timestamp, using @UUID() for example, then link my writer to that parameter, but whenever it tries to write out it creates a brand new stamp.- I can create an attribute from the parameter and use a fanout expression with the attribute value but this always fails to write. And it seems impossible to populate a new parameter from the attribute.I'm trying to do this all in one workbench rather that export attributes as parameters using JSON to a second workbench.It is failing in both Desktop and Server.Any ideas?

183
takashi
Contributor
6 years ago
C
chiangbt
asked in Data
kml convert 3dtiles show error!!!

As you can see, these models seem to show different heights according to latitude. It's weird. Is this because some of the parameters I converted to 3d tiles are incorrect? Can someone help? Thank you

151
C
6 years ago
davideagle
Contributor
davideagleContributor
asked in Data
KML Layer order

In much the same was as you can order the sequence of layers in a PDF, I'd like to do the same in a KML file. I'm not talking about the draw order though, I mean the appearance and sequence of layers. By default it appears to be alphabetic in order. So you'd get:RailRiversRoads...by default if you wrote them out to KML.But what if I wanted:RiversRoadsRailI don't want to put the layers into a KML folder and I don't want to change the featuretype name in any way. I thought it first setting kml_draw_order might be an option but that appears to relate to the render order on the map rather than the layer order in the 'Places' list.Is it possible? Thanks in advance.

694
jdh
Contributor
6 years ago
1
1spatialmary
asked in Data
Unable to access Oracle views generated by Workspace Manager

HiI'm wondering if anyone has encountered this - I'm looking to read some data held in views in an Oracle workspace. The views are generated by Oracle Workspace Manager (viewname_CONF for conflicts seems the naming convention). I can read user-generated views using the Oracle Spatial Reader, but I cannot seem to read the workspacemanager-generated views using the Reader. I can access the data in the workspacemanager-generated views using SQLCreator transformer, but then I have the overhead of exposing all the attributes (which I can probably automate).So FME can access the data as the user I'm connecting as, but seems to ignore these views. Has anyone else encountered this? Is there a way to access them via Reader? some setting I'm missing??ThanksMary

319
1
6 years ago
E
erinjayaustin
asked in Data
PNG Optimization

I'm creating a SQLite Tilecache via the WebMapTiler, with PNG blobs, and would like to use PNG Optimization. This seems to be available in the PNGRaster writer, but I'm not using the PNGraster writer, I'm using the SQLite writer. So, is there any way I can pull that piece of code or is there another transformer I could use to do the same job of PNG Optimization?

155
E
6 years ago
H
honkovam
asked in Data
GML xlink:role

Hello,is there a way to access a value of GML xlink:role property? I can access other xlink properties such as href and title but not this one.Thanks for suggestions.

413
H
6 years ago
T
tderosa
asked in Data
ArcSDE Geodatabase and Shapefile Reader polygon geometry appears incorrectly

When using the geodatabase SDE reader (ESRI) or shapefile reader, the geometry of the polygon feature class does not appear correctly. Recent edits to the SDE data (v10.3.1) are not reflected. In ArcCatalog and ArcGIS on the same machine the data appears correctly however the data is not displayed the same in FME Desktop or Data Inspector. (Note: SDE geodatabase is compressed nightly). I am running FME v2017.1.

41
lars_de_vries
6 years ago
_
_trent
asked in Data
Avoiding SDE spatial index creation

Is it possible to write annotation features to an ArcGIS SDE annotation feature class without a spatial index being created in FME?I am writing annotation features to ArcGIS SDE on SQL Server using the GEODATABASE_SDE writer. I delete the spatial index on the target annotation feature class before running FME. I do not want a spatial index created on the feature class, but FME appears to always be creating one. Referencing this article I have tried the below FME and SDE settings, but the result is always the same.Environment:FME 2018.0.1.0 (20180518 - Build 18310 - WIN32)ArcGIS Desktop 10.2.1ArcSDE 10.2.1SQL Server 2014Feature Type Grid 1 ValueSDE LOAD_ONLY ModeSpatial Index Createdunset/blankYesYes0YesYes-1YesYesunset/blankNoYes0NoYes-1NoYes

563
lars_de_vries
6 years ago
R
rowe
asked in Data
Attribute editing when reading a feature-classes from an excel spread sheet

I currently struggling to get the wanted attribute output in my Writer(FGDB). This is a brief of the current work-space. Reader (Excel Spreadsheet with file-paths) into a Feature Reader (using User Parameters created from the Excel) -Then into A Feature Writer (FGDB using user parameters from the Excel). This currently runs and works however the features created only contains the data/attributes from excel file, I want only the attributes from the feature-class. When Inspecting the Feature reader there is the attributes from the loaded features but I cant interact with them using any known transformers atm.Any suggestions?

81
lars_de_vries
6 years ago
D
dta255
asked in Data
What's the meaning of this error message?

BADNEWS: TEST clause must be specified for factory TestFactory (fcttest.cpp:298)

11
nathanatsafe
Safer
6 years ago
R
reijnen
asked in Data
Error running translation right after start - FME 2015.0 - Citrix

Hi, i'm new to FME.When I add a reader (Oracle Spatial Object), fill in the right parameters and click OK the translation log says: Error running translation (immediately). I do this in Citrix. When I do this in FME on a Windows 2012 Server de translation works fine. What could be the problem?Thanx, Erwin

52
R
6 years ago
F
fsmd91
asked in Data
Condition when shapefile is corrupt

I've got in the log the message about a Corrupt Shape file either because the geometry is badly created or because the shapefile don't have any features in, its empty.What should be the best way to put a value into an attribute when this kind of issue occurs?

71
daveatsafe
Safer
6 years ago
C
chrisdavies
asked in Data
Expose Aliases as Metadata Attributes not working.

I have added the _alias suffix to my field (HS2_SuitabilityCode) that i want to change the alias of to (HS2 Suitability Code) but when i write out to GDB the alias does not update.

285
lars_de_vries
6 years ago
J
jacq
asked in Data
Problem Reading FME created oracle spatial tables in ArcGIS

I have setup the diminfo coordinates, i have created a spatial index and still I am unable to view the oracle table in arcgis. The table is in oracle with geometry and correct diminfo, why can't i see the table in arcgis.

87
J
6 years ago
boubcher
Contributor
boubcherContributor
asked in Data
Google Sheet

I am reading a google sheet and using emailer transformer to send email, everything work good on the desktop, but when published on the server it giving this error Google Sheets: A refresh token is required in order to access this serviceI did get the Client ID and the secret key from google consol, but still giving me the same error any Idea ?

81
danilo_fme
Evangelist
6 years ago
B
brian_c
asked in Data
Clean up csv data

I have a csv separated by semicolon. Some lines have too many semicolons (bad data). To clean up the data I have read the csv with a Text File Reader to read line-by-line and used an AttributeCreator to create an attribute for the number of semicolons in each line. Then I followed that up with a Tester to retrieve the lines with the correct number of semicolons (clean data). Now I have this text line data and need to write back to a csv. I cannot figure out how to write to a csv from the text line data.

272
B
6 years ago
J
joshuadamron
asked in Data
Copying a writer feature type creates a file name alias (Esri/ArcGIS)

Howdy,This question pertains to working with file name/feature class name & name alias for shape files & file geodatabase feature classes.My Question is: Where in FME can I modify the Name alias when writing to a shape file or file geodatabase feature class? I am not seeing this in the parameters or the Format Attributes.Note: This is not a question about a geodatabase field name alias, help on that can be found here: https://knowledge.safe.com/content/kbentry/22423/working-with-geodatabase-field-aliases.htmlHow this became an issue for me:Working with FME 2018.1 I noticed that when working in a workbench I noticed that an issue pops up when I get lazy and instead of adding a new writer feature type I do a quick copy and paste to create a new writer feature type that I then rename (Parameters > General > Feature Class or Table Name). When that pasted/renamed feature class is output the name from the parent/copied writer feature type is written to the name alias.An exa

582
J
6 years ago
M
m8
asked in Data
Is it possible to connect to a MongoDB Replica set?

Hi all, this may be quite similar to this Previous Question but I am just seeing if there is any update. The problem is trying to use the MongoDB reader to access a Replica set held in AWS. Outside of FME you would connect to the database using the following address (with username and password removed and some *):mongodb://user:pass@pro**-shard-00-00-lw***.mongodb.net:27017,pro**-shard-00-01-lw***.mongodb.net:27017,pro**-shard-00-02-lw***.mongodb.net:27017/admin?readPreference=primary&ssl;=true&replicaSet;=PROD0-shard-0FME seems happy to connect to a similar arrangement if the Replica Set is held in a MongoDB on an internal server. But not so happy on an external encrypted server. Does anybody know whether it is possible?ThanksMatt

30
M
6 years ago
M
marionkannengie
asked in Data
How to set the color of an ifc object

Hi everyone, I'm currently doing my master thesis and transforming some data into IFC file... does anyone know how to apply the color parameters to an object ? when I use the appearanceSetter, everything goes well and the result is ok in the inspector... but it seems that the Ifc Writer doesn't know how to deal with this information because in the BIM Vision viewer the colors doesn't appears and if I check my IFC file, there is no line with "IFCSURFACESTYLERENDERING" which should exist to apply a color to an object

1312
M
6 years ago
jwe
Participant
jweParticipant
asked in Data
WorkspaceRunner and Maximum number of concurrent process limit

I am wondering if there is any way to overcome the 7 concurrent FME process limitation of WorkspaceRunner? I am processing 2800 LAS files into DEM's (using a slightly modified version of the excellent example here) using a WorkspaceRunner being fed by a Directory and File Pathnames reader).Our processing workstation has 16 cores and 64 gigs of ram... 7 concurrent instances of this workbench is only utilizing about 35-40% of my system resources, and it takes almost a day to get through all my files.  Is there any way (excluding upgrading to FME server for something that really doesn't need Server's capabilites) to get this running on more cores (or can someone help me figure out how to run it in a highly parallel fashion)?Thanks!

471
takashi
Contributor
6 years ago

Badge winners

Show all badges
30,108
Posts
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.