Skip to main content

Data

Using readers and writers to extract and load data.

  • 7,300 Posts
  • 26,826 Replies
7300 Posts
T
tigerwoulds
 Data
dszarka
Contributor
dszarkaContributor
 Data
P
peterkt
 Data
nz
nz
 Data
File Geodatabase to File Geodatabase translation with @Value Additions

Hi Forum,Apologies if this has been posted before but speaking to the Live Chat team they were unfortunately unable to provide a detailed solution.I have a ESRI File Geodatabase containing features with attributes, Number, Address, Town. I am translating from one FGDB to another (also as a test the same FGDB) with the addition of an Attribute Manager in the middle in order to create a new field "SEARCH_ADDRESS" I create a new Attribute with the expression as follows:@Value(NUMBER), @Value(ADDRESS), @Value(TOWN).  The attribute manager accepts these as valid field expressions, however the new field does not carry over to the output Feature class. When the translation is run I get the error that there conflicting Object ID's "User field name 'OBJECTID' conflicts with a value of feature type parameter ' Object ID Field' ('OBJECTID') for table/feature class 'DELETE_TEST_OUTPUT'. The user field will be ignored"I spoke with Safe Live

960
nz
dberger106
Contributor
dberger106Contributor
 Data
M
mariofederis
 Data
pratap
Contributor
pratapContributor
 Data
tnarladni
Enthusiast
tnarladniEnthusiast
 Data
C
cdog89
 Data
Are dynamic websocket stream ids possible?

I am using a websocket to stream data from FME server (2018) to a web app in a browser. The data I am streaming out can be classified by its location, and the user of the web app only views one location at a time. So ideally the websocket stream id would be something like '<location>_data', where <location> is dynamic and set by the feature in the workspace.This doesn't appear possible though. Setting up the workspace like this seems to instantiate the stream id of the websocket sender with the first feature to pass through it, and then fixes it for the remainder of the job. E.g. if location 'X' was the first feature to be processed, the stream id would be 'X_data' even when locations 'A', 'B' or 'C' passed through. Is this how the websocket sender works? Is there any workaround for this?It is possible for me to stream all data for all locations out through a websocket with stream id 'data', however this is very wa

1200
C
B
bibold
 Data
C
colin_forsyth
 Data
How can I extract the html table from kml_description?

I am trying to get the attributes from a point layer in a KMZ file stored in a HTML table within kml_description...... I have tried using HTMLToXHTMLConverter, but the features always fail. Currently using FME 2013 SP3.  FME Data Inspector is able to read and list them under "Attributes". I followed the instructions from:https://knowledge.safe.com/articles/19918/how-to-expose-feature-attributes-from-kml-tag.html Here is an example of the html code that comes between <description> and </description><html lang="en"><head><meta charset="utf8"/><style> * { margin: 0; } html, body { height: 100%; margin: 0; padding: 0; } h2 { textalign: center; background: #e5eCf9; } #summaryData { fontfamily: 'Helvetica Neue', Arial, Helvetica, sansserif; fontsize: 12px; width: 350px; } #summaryData th{ paddingright: 20px; width: 40%; } .fire_title { background: #ffffff; marginbottom: 15px; } .box { textalign: left; padding: 1.5em; paddingtop: 1em; marginbottom: 1.5em; b

2860
xiaomengatsafe
Safer
opowell
opowell
 Data
Filter option in CSV reader parameter in FME 2018.1 disappeared? How to filter at source?

Hi, I'm working with a CSV of 7Millions + rows which takes ages to run,As I am working and amending/ improving the workflow I'd like to use a sample of the data.I want to only use rows where there is a AVL_ID field starting 101 or 110 or 111... data is looking like numbers (7 digits) e.g. 1011234I'd like to only read and use the rows where the AVL_ID field are starting with 110.1. 2016 workflow and datasetI started my workflow in 2016, so opening my CSV reader parameters, I see a Filter option . I thought I could filter it at source but my data came with the fields in Numeric format so I can't use the Filter AVL_ID ^110* as described on this web page: - (under Schema Attributes > Filter by Field Value) http://docs.safe.com/fme/2016.0/html/FME_Desktop_Documentation/FME_ReadersWriters/csv/CSV_reader.htm I tried AVL_ID >= 1100000 but it does not do anything. see image below 2. 2019 workflow - FME 2018.1 CSV reader If I add a new CSV working on it now on FME upgraded

1220
erik_jan
Contributor
M
manideveloper4u
 Data
J
jbs
 Data
G
georgr
 Data
Unable to read features from ArcGIS REST Featureservice, but successfully connected

I´m able to connet to an arcgis featureservice with the "Esri ArcGIS Server Feature Service" reader via token authentication and can choose the available layers. When I want to read the features i get following output:ArcGIS Feature Service Reader: Requesting metadata for Feature Service at 'https://xxx/FeatureServer' ArcGIS Feature Service Reader: Found layer/table 'xxx' with ID 4 for feature type 'xxx' ArcGIS Feature Service Reader: Requesting metadata for layer/table 4 of Feature Service at 'https://xxx/FeatureServer' ArcGIS Feature Service Reader: Querying layer/table 4 for object IDs, where '1=1' ArcGIS Feature Service Reader: Encountered an unexpected error. The error code from the server was '400' and the message was: 'Unable to complete operation.'. Details: 'Unable to perform query operation.' A fatal error has occurred. Check the logfile above for detailsI get this error on all available layers. The fea

4010
C
D
dmatranga
 Data
A
aquamarine
 Data
A
aquamarine
 Data
jstanger
jstanger
 Data
V
vanhornsky
 Data
D
dtvladsilviu
 Data
Error - Writting in ArcGIS Feature service (Failed to reproject feature)

Hello,I have a DWG and an SQL server as readers and the writer should be a feature service on our portal.Problem is at the very end and i get the following error log:Reprojector: Invalid reprojection parametersCoordinate system conversion during translation is not possible -- cannot output feature with coordinate system '_EPSG:31700_0' to output dataset with established coordinate system '_SPHERICAL_MERCATOR_0'=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-Feature output statistics for `ARCGISPORTALFEATURES' writer using keyword `ARCGISPORTALFEATURES_1':=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Features Written=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-==============================================================================Total Features Written 0=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-Reproject: Could not reproject t

1790
D
V
vamsi.boppana
 Data
tsirkuse
Contributor
tsirkuseContributor
 Data
Validation error in GML created with FME

Hello,  I am wondering if I am missing something.  I am exporting some records from an Oracle dB to a GML2 file.  When I validate the resulting XML using online validators I don't find any errors.  However when I do the same in the FME validator I find an error.  I am a bit surprised by this because the XSD and FME was creating from FME.  I am missing something? This are the files (i renamed the .txt to be able to upload them)  Thank you Feature Type    Inspector_2Coordinate System    UnknownDimension    2DNumber of Vertices    0Min Extents    nan, nanMax Extents    nan, nanAttributes (19)    _creation_instance (32 bit unsigned integer)    0    _xml_error{0}.col (string)    41    _xml_error{0}.desc (string)    no declaration found for element 'gml:Box'    _xml_error{0}.file (string)    C:\Users\Me\Desktop\GML\test150319.gml    _xml_error{0}.line (string)    4    _xml_error{0}.type (string)    Error    _xml_error{1}.col (string)    41    _xml_error{1}.desc (string)    attribute 'srsName

950
trentatsafe
Safer
rob_fme
Participant
rob_fmeParticipant
 Data
G
guthima
 Data
Show more activity

Badge Winners

  • Webinar Watcher (Silver)
    markbodhas earned the badge Webinar Watcher (Silver)
  • Webinar Watcher (Grey)
    candacekhas earned the badge Webinar Watcher (Grey)
  • Welcome Back
    candacekhas earned the badge Welcome Back
  • English Speaker
    blehmdavidhas earned the badge English Speaker
  • Webinar Watcher (Grey)
    blehmdavidhas earned the badge Webinar Watcher (Grey)
Show all badges

Community Stats

32,757
Posts
124,226
Replies
41,278
Members
Terms & ConditionsAccessibility statement
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.