Skip to main content

Data

Using readers and writers to extract and load data.

  • 6,932 Posts
  • 25,504 Replies
6932 Posts
garyb
Contributor
garybContributor
asked in Data
Help logging onto remote server

I'm trying to write a CSV file to a computer that is not on our domain, so I have to have FME login to it before it can write out the data. How do I pass the username:password credentials to the writer so FME can log onto that computer?

80
david_r
Evangelist
M
morijlumos
asked in Data
Geodatabase Error (-2147024894): The system cannot find the file specified.

Hi, I am using a Geodatabase writer and I keep getting the error: Geodatabase Error (-2147024894): The system cannot find the file specified. Could not open File Geodatabase dataset `\\\\Vdi-standard103\\data\\LumosM4WMS.gdb\\Line_FPA Multiports' for writing. I made sure there were no locks on the database. I'm not sure why this is happening, do I have to pre create the feature classes that I am expecting to be written? that seems like unneccessary work as I have it set to fan out based on a name field in the SQL Server Database. Maybe I'm missing a setting? Any Help is greatly appriciated

1470
M
K
kcheng007
asked in Data
feature merger and join using wildcard

HI All, I never really thought about this one until now, but is it possible to featuremerge on wildcard values? For example, I have a point file with an ID value. The ID values are unique. ie A, B, C, D I have a many table of values with a ID value of A_1990, A2, A, B1,B2,BC,D1,D3,D9 Is it possible feature merge based on a wild card? ie.. *A* join to A_1990,A2 *B* joins to B1,B2,BC *D* joins to D1,D3,D9

270
ebygomm
Influencer
T
tgilli
asked in Data
csar to csv

Hello, I'm new to FME 2014 and trying to figure out how to transform a csar file to csv. Can someone point me in the right direction or show the steps? Very much appreciative.

220
T
nic_ran
Contributor
nic_ranContributor
asked in Data
Synchronous (mid-translation) database inserts

Hi, I'm looking for best practice solutions for writing to a SQL Server database mid-translation. I need to write mid-translation because I have foreign key constraints on the database and some feature types need to be inserted before others. As far as I'm aware there's no way of telling the writer to insert feature types in a specific order. I would prefer to do all this in a single workspace (ie. not have multiple workspaces called by the WorkspaceRunner). I think my only solution is to use the SQLExecutor but inserting records using this transformer is not well documented and it does not seem to provide any feedback as to it's success. Any thoughts? thanks, Nic

50
nic_ran
Contributor
A
aleksandar
asked in Data
Identity_Insert in SQL Server Non-Spatial Error

Hi, I have one SQL Server Non-Spatial writter with ~80 tables (feature types), and need to insert into identity column. I enable this option in each writer's Feature Type, but it is still throws me error that FME cann't perform SET operation on my table(s). What is all about? Thanks

70
A
J
jo
asked in Data
Reducing File Sizes

Hi, Is there a way of reducing the size of a TAB file that I've created in FME? Any help with this or info on reducing any other files sizes would be greatly appreciated. Many thanks Jo

460
J
J
jaslee
asked in Data
UTF-8 in Sqlite3 database writer

Hi, I am translating a CSV file to a Sqlite3 database. Some of the entries have accented characters, e.g. "Mhaol Mhòr" - a mountain in Scotland, but after processing it is displaying as "A' Mhaol Mh�r" in the target database when I query the record. I can't see anywhere in the writer where I can specify the character encoding. Any help or advice much appreciated, thanks. Jason

3185
J
R
robbie_botha
asked in Data
How to Fanout vir .GDB contents?

Hi there, I have a fully functional workspace that dynamically does calculations on shape files contained within a selected folder. My output is an xls that is fanned out baie the “filename” attribute retrieved from the “FileNamePartExtractor” transformer. My problem is, I need to do the same calculation for a GDB file now, containing multiple layers(such as WATER, FORREST, etc). Now obviously, “filename” only retrieves the name of the .gdb (AFR_Complete.gdb in this case) so that no longer works. I’ve also tried “fme_basename” and “fme_dataset”, but with no success. Is there a way that I can fanout by the contents of the GDB file? Thanks in advance

30
R
J
jimbob
asked in Data
placing a point from coordinates in csv

Hey i am trying to do a simple workspace of placinig a point at Lat & Long coordinates within a CSV file if i inspect the data i can see the coordinates but when i link in the VertexCreator transformer and put it to Lat and Long, i get a error that it cant find the data i have done this a few time before on different sets of data, but i cant seem to work this one out!! cheers for any help you guys can give, i am sure i am just missing something simple! cheers

110
david_r
Evangelist
A
alessandro
asked in Data
How to email elaboration results on FME Server

Hi, I am developing a workspace (published on FME Server) triggered by an email whose attachments are elaborated and the final result, an xml file, emailed back. The xml file is not accessible from une of the attributes of the features, it is an AIXM 4.5 xml file created by the workspace at the end of the elaboration and usually stored in a file on the disk. So I guess I should retreive that file and send it by email to the user, but I don't know how... I think I can't use the Job Submitter and Data Download Services because I I need the email with its attachments to activate the workspace. Does someone know how to solve this issue? Thanks, Alessandro

30
A
S
subrat
asked in Data
How to call a workbench from POST_COMMAND??

Hi, I have two workbenches published in server. First workbench generates an FFS in server. Upon completion of first workbench, irrespective of success/failure, server should call second workbench using POST_COMMAND in SUB_SECTION with FFS location as published parameter. I can execute the workbench on system using command line, but i dont know the syntax for above workbench call from server. Any pointers will be highly helpful. Thanks, Subrat

70
S
A
andrewh
asked in Data
Can the TCPIPReceiver within a workspace running on FME Cloud listen on privileged ports?

Can the TCPIPReceiver within a workspace running on FME Cloud listen on privileged ports?

30
A
C
cng
asked in Data
Unable to access Excel file from shared location in FME server

Hi, We are unable to access Excel file from shared locationin FME server, get error "XLSX Reader: Failed to open the dataset 'given Shared path'. Error message was 'can't open file for reading' , but the same excel from local drive we are able to access without error. Any idea Regards CNG

670
C
R
robbie_botha
asked in Data
Failing to write to SDE database

Hi there, This is the first time I'm attempting to write to an SDE database, and I'm encountering some hiccups. 1. If I use an SDE30 connection, everything works 100% according to the workspace, and despite it displaying that all 33079 my point features succesfully go to the writer (with the translation successful message) there is nothing in the database when I check in ArcCatalogue/Map. The feature class is not even created, never mind blank. 2. If I use GEODATABASE_SDE writer, I get the following error in FME, which also fails the translation: Unable to create the table/feature class TUN_MN_TEST. When writing to a pre-9.2 Enterprise Geodatabase, a value of 0 is not appropriate for the GEODB_XYSCALE. Specify a number greater than 0 A fatal error has occurred. Check the logfile above for details What makes this case even stranger, is that I got option 2 to work once. Without changing a single thing. It actually created the feature class and everything seemed fine, and when I tried to

770
R
A
amy
asked in Data
How to change reader's format from personal geodatabase to file geodatabase or enterprise geodatabase?

Hi, I had a workspace with a personal GDB reader. Recently, our data has been migrated from personal GDB to file GDB. With same database schema, is there a way to just change reader's format in a workspace? Thanks in advanced!

40
A
U
uccelli
asked in Data
AutoCAD block to AutoCAD Block

Hi, I try to do a very simple translation AutoCAD to AutoCAD (no transformers, just a change of version). everythings works fine except that the blocks are not translated, even if I include the reader file as template for the writer. Does any one has a solution ? I want to obtain the same structure as the original file... Thank's in advance

80
gio
Contributor
adrian
Contributor
adrianContributor
asked in Data
Changing bounding box parameters in URL for WMS service on FME Server

Hi guys, I have a WMS running on FME Server which is basically taking an image of an area, cutting out a small user defined area and returning it to the user as a png file. The question I have is related to changing the bounding box in the URL request, when I change it I still get the same map as in the original workbench I uploaded to Server. I am sure it is something simple I have missed and any help would be much appreciated so thanks in advance.

250
adrian
Contributor
T
timewatcher
asked in Data
Read multiple file and save on multiple file.

Hello, I have points on many file on a side. On the other side i have a directory with multiple cad file each cad have 1 boundarie I make a workspace with a buffer/clipper and a reader to read all points. I don't want to insert each boudary and insert writers with the same name. I want to scan the directory for cad file, For each file this write a csv file with the point. All of this work perfectly for 1 file but is a way to make it for each file ?

21
gio
Contributor
A
aleksandar
asked in Data
Unable to inspect GML file

Hello, I got GML file trough translation of SQLServer Spatial into GML, but I can not inspect it, or open it to graphicaly see features. XMLValidator passes the file against schema. Here is a link to my resulting GML file: https://drive.google.com/file/d/0B8kUf-xMW81XY09lV2prQ3VUVlE/edit?usp=sharing

40
A
L
longhornfan
asked in Data
I have an Excel reader with counties. I want to filter another layer based on the counties in the Excel file

Reader 1: Excel Data with a County column Reader 2: Ownership Parcels for Northeast United States with a County column I want to filter out all counties that are not listed in the Excel Data. This will greatly reduce processing time since the Excel file never has more than a 100 records daily. While the Ownership always has millions of records. If today's Excel Data has County A, B, and C then I only want Ownership Parcels that are in County A, B, and C. I hope that makes sense. What's the best way to filter the Ownership Parcels with the everchanging Excel Data by the county field in the Excel Data?

80
L
B
bas
asked in Data
FME script terminates/crashes when attempting to write text.

Hi All I have made a FME script that loads data from an SDE Oracle database and from various csv files. The dat are manipulated and finally summarize in an attribute as a text in XML format . Finaly the text is written to disk using a text writer. This script has been running in a weekly batch job succesfully until 2 weeks ago. Since then, when the script is run in batch or in the workbench, as soon as the writer attempts to write the the text file, a windows message appears saying that FME.ex stopped working and needs to close. After that another error appears with a runtime error. When I run the script in the workbench the last lines in the logwindow are like this. unable to realloc 73638411 bytes This application has requested the Runtime to terminate it in an unusual way. Please contact the application's support team for more information. i = 72 String http://www.safe.com/fme/xquery/functions is still in the pool Zorba Internal Fatal Error in ..\..\src\store\naive\string_pool.cpp:4

71
B
E
erin
asked in Data
Exclude records based on another dataset

Good morning, I am using SQL Creator to query a table in SQL Server. This table has about 45M records. My VPN only stays connected for 24 hours, and my workspace needs more time to run. Last night, I was up to 27M records written to text. In lieu of starting over, I was hoping there is a way to run the workspace again, but exclude the 27M records already written. There is a unique field in the table, so it would just be a matter of excluding based on that one field. I cannot figure out how to do this. I do have a list of the unique IDs that were already written in a MS Access database table. Is there a transformer that would allow me to do this? Thanks! Erin

210
david_r
Evangelist
R
robyn
asked in Data
Enterprise Geodatabase reader/writer failing to load client libraries

Hi All, We have received a number of cases in support recently where a Geodatabase_SDE direct connection to an enterprise Geodatabase sitting on SQL Server has failed due to the inability to load the client libraries. Once we have determined that it isn't related to a 32 bit vs 64 bit issue the problem manifests as either the error message "fme.exe - System Error The program can't start because sdemssqlsrvr102.dll is missing from your computer. Try reinstalling the program to fix this problem." or "Could not open the Enterprise Geodatabase. The error number from ArcObjects is: '-2147155644'. The error message from ArcObjects is: {Cannot connect to database because the database client software failed to load. Be sure the database client software is installed and configured correctly.} " In all cases these workspaces also contained a reader/writer that was accessing some other Microsoft format - e.g. Personal Geodatabase, MS SQL Server non-spatial, Excel reader etc. It turned out that Wi

60
R
J
jroge087
asked in Data
Leica DXF to GIS feature class

Hello, I am working with DXF files which are outputs from Leica GPS units. When I bring the DXF into FME as a reader it displays the point data and attributes as seperate individual features. What is the best tranformer to use to combine these into one point feature with an attribute from each one. My goal is to end up with a point feature in a file geodatabase. Thanks in Advance

91
gio
Contributor

Most helpful members this week

Badge winners

  • FME Form Advanced Training
    josiahmillarhas earned the badge FME Form Advanced Training
  • Teacher (Grey)
    marthas earned the badge Teacher (Grey)
  • English Speaker
    ntaplinhas earned the badge English Speaker
  • Welcome Back
    ntaplinhas earned the badge Welcome Back
  • FME Form Basic Training
    selasikhas earned the badge FME Form Basic Training
Show all badges
30,847
Posts

Popular tags

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.