Skip to main content
  • EN

Data

Using readers and writers to extract and load data.

  • 7,091 Posts
  • 26,100 Replies
7091 Posts
cheffing
cheffing
asked in Data
Error "Unable to open log file"

I often get this error, while the Workspace-Runner was started with new parameters. Reducing the log-level did not help Any idea how to fix this? I found no comparable community-Item .. I am calling a Workspace-Runner within the project. The workspace is called thousends of times. The calling workspace and the called one work each into their own log-Files. In this example 954 of 1461 calls crashed. In the logfile of the called wsp there are now errors mentionend.Many workspace-calls crash because the newly initialized workspace can't access the logfile because the last call has not yet closed it.This is the error description:I would like to use the option with concurrent processes, but it increases the error rate.The called wsp has one logger configured like this:What else is needed to give you an idea of the problem?Looking forward to a solutiion,Christoph 

11390
cheffing
mcgregrr
Contributor
mcgregrrContributor
asked in Data
How to transpose an excel sheet, but only a couple of columns.

I have a logger output excel spreadsheet where the easting, northing, height, and sensor value are in one column but I need them each to be an independent column. So I need to add four new columns to the excel and populate them from the one column while leaving the loggercode and dateutcdate alone.

40
mcgregrr
Contributor
rakeshreddy0996
rakeshreddy0996
asked in Data
write values from excel excel exact position

i have information table1 like below Colomn\\RowABCD1SNSFruitCOSTQuantity21Apple20per Peace32Banana3per Peace43Orange8per Peace54Mango50Per KG65Cherry250Per KG76Papaya40Per KG87Graps80Per KG98Dragon200Per KG109Kiwi30per Peace1110CustedApple60Per KG1211Fine Apple40per Peace1312Green Apple25per Peace and having another table2 Colomn\\RowAB1Fruitapple2Price  i need write value at table2 Cell position B2 with 20 from table 1

120
rakeshreddy0996
2
206206
asked in Data
texture building without stretching

hello,i am trying to texture a building but the image just stretches over the whole wall.what i want is for it to stay the size it originally was and if the whole wall is not filled in that it puts another one next to it.

110
2
terezia86
terezia86
asked in Data
how to adjust writer to a flixible folder?

HI,how can I adjust the writer, so I can specify the destination folder every time different?I have the same Workspace, but I need to write the results all the time in the other Folders. I do not want to create/add all the time a new one. And I need to publish it into a Server, so the writer, and also the reader need to be a flexible.Thanks

30
itay
Supporter
xander
xander
asked in Data
SQL database records to featureclass

Hi. I'm a new to FME and so far I am excited and overwhelmed. I am trying to connect to an exteral SQL database (CAD 911), run query, geocode query results, and write to an existing esri point featureclass. I'd like this to be a scheduled job where it updates the featureclass with new sql database records daily. This seems like FME 101...

90
brianatsafe
Safer
S
susan
asked in Data
CityGML_data_Geometry_Repair

I have a set of the CityGML data (LoD2). I have to add the missing ground floor layer “building footprint”. Also, repair other errors in the geometry. Is there an automatic way to do that?

860
virtualcitymatt
Celebrity
pongodai
pongodai
asked in Data
Error connecting FME Desktop to ArcGIS Online

I am trying to connect FME desktop to ArcGIS Online. Taking hint from the article in this url, the networks team whitelisted www.arcgis.com and also bypassed authentication. Attached is the image showing the steps carried out by them (for people with knowledge of proxy/firewall). I have rubbed out some parts.I have been able to create Web Connection however unable to retrieve data from AGOL. I get the error file attached agol_fme_error.txt when trying to fetch Feature Service in the AGOL in Esri AGOL Feature Service Parameters dialog box.I didn't mention filtering to the networks team before carrying out the work. Could it be a reason? Any other suggestions are welcome.Extra information:a. FME Desktop 2018 64bitb. Able to login to AGOL in web browsersc. Able to connect to AGOL via ArcGIS desktop v 10.6 Thanks in advance Vidya

247
pongodai
J
jeano
asked in Data
Postgis writer stop working

Hi,My problem is about a process that update a postgis table from an other geographic database. Sometimes the import stop working nearly at the end as you can see :POSTGIS writer: 6589 of 6765 features writtenPOSTGIS writer: 6601 of 6765 features writtenPOSTGIS writer: 6606 of 6765 features writtenPOSTGIS writer: 6628 of 6765 features writtenPOSTGIS writer: 6649 of 6765 features writtenand then, no more log for hours.The fact is that it doesn't seems to come from data, cause when i start the process by little packet sometimes it works, actually this slowness seems to be unpredictable. But always occur at the end of the process. And yes computer is working and doesn't seems to be saturated : Proc 8%; Memory 21%. Does someone have any idea of what can i try to understand what happen ??Thanks

160
itay
Supporter
ostoja
Contributor
ostojaContributor
asked in Data
Coordinates precision changed when writting to ESRI FGDB

Hi all,I noted that coordinate precision of the objects is changed when loaded into the ESRI FGDB.Using the coordinate rounder, all objects in my migration process are rounded on three decimals (on a mm), and even the data in the source system have only 4 decimals.I want to load them as such into the ESRI FGDB using FGDB writer. Source for writing is FFS file.After successful loading process, I checked results in ArcMap and in Inspector. What I can see is that objects and vertices have many more decimals then in the data, which I loaded.The resolution of the database is 0,0001 and tolerance is 0,001. This is also not clear to me, how I managed to write so many digits with 0,0001 resolution.I removed all coordinate systems in order to avoid coordinate transformations. I tried to set same coordinate system on the target as on the source, but unfortunately, the result is the same.Does someone have an idea why does extra vertices are appearing? How I can simply write the data which I have

720
ostoja
Contributor
T
tfsrichard
asked in Data
The current version does not support editing (base, consistent, or closed) [An open transaction was detected

I have a ESRI Geodatabase (ArcSDE Geodb) writer which is returning: An error occurred while attempting to start an edit session. The error number from ArcObjects is: '-2147217150'. The error message from ArcObjects is: {The current version does not support editing (base, consistent, or closed) [An open transaction was detected. All user transactions must be closed prior to StartEditing.]}The problem is there are no locks on this feature class layer so no open transactions? 

1750
gsri
Contributor
mredpath
Participant
mredpathParticipant
asked in Data
ArcGIS REST API Truncate operation?

I saw on this page ( https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/arcgisonlinefeatures/ft-parameters-w.htm ):The ArcGIS Online Feature Service writer performs a truncation by reading all feature IDs from the layer, and then making deletion requests in batches according to the Features Per Request advanced parameter.I was wondering if there were plans to incorporate the ArcGIS REST API Truncate operation?https://developers.arcgis.com/rest/services-reference/truncate-feature-layer-.htm

740
debbiatsafe
Safer
T
tobiasb
asked in Data
Editing CityGML building height

Hello FME Community, i am currently trying to combine stock and flow simulations with CityGML. As a tool in between i try to utilize FME.My question:How can I edit the height of a citygml building (LoD2)? I am trying to increase the number of floors and try to show a before and after version.Can i just change the z-axis of the building?Best regardsTobias

330
T
K
karlos86
asked in Data
Aecosim written IFC custom attributes not appearing

I'm an infrequent user of FME so apologies if this is a simple solution. I have an IFC file that was created by exporting from Aecosim and I'm trying to expose the custom attributes (See image below) that I can see when opening the ifc in Solibri. I've searched this community and found nothing that can help me so far. If anyone has a solution or a way forward, your help would be much appreciatedI should add, my goal is to get this information out into an Excel document.Thanks for your help

80
K
A
am
asked in Data
GML Reader: "Unable to determine features from the parsed XML Schema files"

I get the error above and the following warnings<SOURCE_GML Reader> - Unable to determine features from the parsed XML Schema files, the following namespace URIs were processed<SOURCE_GML Reader> - XML Namespace URI: http://www.w3.org/1999/xlink<SOURCE_GML Reader> - XML Namespace URI: http://www.w3.org/2001/XMLSchema<SOURCE_GML Reader> - XML Namespace URI: http://www.w3.org/2001/XMLSchema-instanceThe same file is read by QGIS without any problems.Any Ideas how I can find out the reasons?

970
virtualcitymatt
Celebrity
C
craniumak
asked in Data
Driver GPS Point Start Stop Sequence

I am looking to take a point feature class that acquires a GPS location from our Utility trucks every 15 seconds and create routes driven based upon historical data. End goal is I would like to build a polyline feature class to reduce the amount of data that I am publishing to our Portal to improve the performance of querying data, as we are acquiring approximately 2.5-3 million points within a 30 day span.Below is an example of the data being received.Here is what the data means:Vehicle is Offline = IsIdle - 0 & GpsActive - 0Vehicle is active but in a Idle State = IsIdle - 1 & GpsActive - 1Vehicle is Actively Moving = IsIdle - 0 & GpsActive - 1The part I am getting stumped on is how I can define routes driven. In the example above, there would have been 2 routes driven. The first route would be fromto  and the second route being toBelow is an example of where I would like to take the data, with the addition of some sort of RouteID field. Any help is greatly appreciated.

100
ebygomm
Influencer
T
thomas_
asked in Data
Is there a way to generate multiple Excel workbook using only one Writer?

I have to generate approximatively 850 Excel workbook and I was wondering if it was possible using only one Writer or if I had to use 850 Writers.I thought of the possibility of generating 850 sheets in one Excel workbook, but I would have trouble actually opening the workbook with my computer (lot of memory used).Also I work with a 2017 version of FME (I stumbled in the past on issue that could be esaily resolved with 2018, but I had to work in the limit of 2017).Thanks

290
david_r
Celebrity
L
loganj
asked in Data
How can i read/write user attributes from dgn elements

I have a dgn that have attributes for some elements:these attributes i'm guessing that are from exporting a shp file to dgn directly from microstation.How can i read these attributes and if possible create new one or change the value of existing ones.Is it even possible?Inspector does not show these attributes anywhere.Readers also does not show them anywhere

11912
ebygomm
Influencer
T
tmtech
asked in Data
associate subtext to the heading text

Hi So I have a text document and I need to parse into specific headings and then extract that heading and all the sub text. The issue is the subtext is lettered. Is there a regex syntax that will continue to extraxt until it finds a new match? any ideas? Im using string searcher and have managed to get all this data as seperate lines, just not sure if its easier to try and find a way to put the data back together or if theres a more efficient way to parse Current using syntax: chicken{1}\\s|(. Example: I need every line that starts with "chicken" the chickens name and all the numbered lines below TEXT TEXT TEXT TEXT TEXT TEXT TEXT TEXTTEXT TEXT TEXT TEXT TEXT TEXT TEXT TEXTChicken: Rene(1) lays three eggs a day(2) escaped two weeks agoTEXT TEXT TEXT TEXT TEXT TEXT TEXT TEXTChicken: Stacey(1) etcand so on  

60
gio
Contributor
F
fhilding
asked in Data
Send JSON via websocket

I'm trying to send a message to the websocket server on my FME Cloud instance. I can successfully transmit the following: {"ws_op" : "send","ws_msg" : "hello"} But I want to send a JSON message as "ws_msg", so I tried: {"ws_op" : "send","ws_msg" : fme_get_attribute("payload")} Which isn't received on the other end, similarly to if we have an incorrect message, i.e. without the "send message"-format from the documentation of the WebSocketSender. I would guess it's something with the quotes around the message, but I am unable to escape quotes in the message formatting window. So, how can I send a JSON message (Payload-attribute attached) to a websocket using FME? {      "type": "Feature",      "properties": {       "icon-image": "pulsing-dot-blue"},      "geometry": {        "type": "Point",        "coordinates": [          17.3016102,          59.6615453        ]      }    } 

103
F
mike_gresh
Contributor
mike_greshContributor
asked in Data
KML view setter with exif data

Hi,I am in the process of creating a workbench to transform geotagged jpegs into KMLs. Ideally I want my photos to popup in google earth balloons at the location they were taken at. In order to do this I first need to extract the exif geographical information i.e.latitude, longitude, altitude, bearing etc. I would've thought that KML viewsetter would be the right tool for this however when I fill in the location fields with the appropriate exif information the KML still defaults to latitude 0, longitude 0. I'm quite sure I've got the right parameters "jpeg_exif_gpslongitude", "jpeg_exif_gpslatitude" etc. but it's not working for me.Any ideas from the community?Thanks,Mike

100
martinkoch
Supporter
paulopires16
paulopires16
asked in Data
LAS (LiDAR) to OBJ to FLT (OpenFlight) with textures

Is it possible with FME Desktop?LAS (LiDAR) to OBJ (Wavefront) to FLT (OpenFlight) with textures???Thanks

180
sigtill
Supporter
heidelbergh
heidelbergh
asked in Data
Error in PDF Generation em version 2019.2.0.0

Greetings, I´m getting a strange error when trying to generate a PDF in 2019.2.0.0 version (Build 19752 - WIN64 or Build 734 - win32).  The same flow works perfectly in version 2018.1.2.0 Build 18590 - WIN32, and we are planning to migrate to the new version soon but in our tests we enconter this error. For some unknow reason, in this example,some polygon near the "LTP" and "FTP" entrances in the 2nd table are dissapearing. In my original flow (not this sample), this behavior occurs in the polygons in the middle of table, so I don´t think it´s a problem related of the fact of be one of the last rows.  I generated a small flow with the same problem to reproduce the situation for your avaliation.  Thanks a lot for the help.     

60
debbiatsafe
Safer
philippeb
Enthusiast
philippebEnthusiast
asked in Data
Use newest FME Desktop with an old FME Server

Hello there!If I want to use the newest FME Desktop functions (v2019) with an old FME Server (let's say v2017), do you think it would be possible to publish on my server a worskspace created on FME Desktop 2017 who will call (with a SystemCaller or whatever) a batch file that will run FME Desktop 2019?Batch file line command example"C:\apps\FME2019.1\fme.exe" "\\NASASERVER\c$\FME\Workbench\Talk2Aliens\SolutionHere.fmw"First of all, is that legal? Does Safe permit that?Secondly, would that work?Thanks!

620
J
P
paulg
asked in Data
ESRI PORTAL ITEM Fanout

Hi, Could anybody tell me if this possible with FME please? I'm new to using ESRI Portal Items and FME .I have a Feature service on Portal published via arcgis server from an enterprise geodatabase in Oracle, I wish to create views of this data in Portal by Fanout on an attribute value. e.g a Feature service of Polygons with and attribute of Sheet_no, I'd like to create a Portal item for a definition query on the master layer for each group of unique Sheet_no values, giving these items a new name based on the original item name + the Sheet_no... The data cannot be duplicated and the view must reference the original service and data source.This apparently can be done using the Portal Python API .... but I'd like to see if it can be done in FME. Any pointers are appreciated RegardsPaulg  

100
P

Badge Winners

Show all badges

Community Stats

31,807
Posts
120,816
Replies
39,435
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.