Using readers and writers to extract and load data.
Recently active
Hi, Is there a way of reducing the size of a TAB file that I've created in FME? Any help with this or info on reducing any other files sizes would be greatly appreciated. Many thanks Jo
Hi, I am translating a CSV file to a Sqlite3 database. Some of the entries have accented characters, e.g. "Mhaol Mhòr" - a mountain in Scotland, but after processing it is displaying as "A' Mhaol Mh�r" in the target database when I query the record. I can't see anywhere in the writer where I can specify the character encoding. Any help or advice much appreciated, thanks. Jason
Hi there, I have a fully functional workspace that dynamically does calculations on shape files contained within a selected folder. My output is an xls that is fanned out baie the “filename” attribute retrieved from the “FileNamePartExtractor” transformer. My problem is, I need to do the same calculation for a GDB file now, containing multiple layers(such as WATER, FORREST, etc). Now obviously, “filename” only retrieves the name of the .gdb (AFR_Complete.gdb in this case) so that no longer works. I’ve also tried “fme_basename” and “fme_dataset”, but with no success. Is there a way that I can fanout by the contents of the GDB file? Thanks in advance
Hey i am trying to do a simple workspace of placinig a point at Lat & Long coordinates within a CSV file if i inspect the data i can see the coordinates but when i link in the VertexCreator transformer and put it to Lat and Long, i get a error that it cant find the data i have done this a few time before on different sets of data, but i cant seem to work this one out!! cheers for any help you guys can give, i am sure i am just missing something simple! cheers
Hi, I am developing a workspace (published on FME Server) triggered by an email whose attachments are elaborated and the final result, an xml file, emailed back. The xml file is not accessible from une of the attributes of the features, it is an AIXM 4.5 xml file created by the workspace at the end of the elaboration and usually stored in a file on the disk. So I guess I should retreive that file and send it by email to the user, but I don't know how... I think I can't use the Job Submitter and Data Download Services because I I need the email with its attachments to activate the workspace. Does someone know how to solve this issue? Thanks, Alessandro
Hi, I have two workbenches published in server. First workbench generates an FFS in server. Upon completion of first workbench, irrespective of success/failure, server should call second workbench using POST_COMMAND in SUB_SECTION with FFS location as published parameter. I can execute the workbench on system using command line, but i dont know the syntax for above workbench call from server. Any pointers will be highly helpful. Thanks, Subrat
Can the TCPIPReceiver within a workspace running on FME Cloud listen on privileged ports?
Hi, We are unable to access Excel file from shared locationin FME server, get error "XLSX Reader: Failed to open the dataset 'given Shared path'. Error message was 'can't open file for reading' , but the same excel from local drive we are able to access without error. Any idea Regards CNG
Hi there, This is the first time I'm attempting to write to an SDE database, and I'm encountering some hiccups. 1. If I use an SDE30 connection, everything works 100% according to the workspace, and despite it displaying that all 33079 my point features succesfully go to the writer (with the translation successful message) there is nothing in the database when I check in ArcCatalogue/Map. The feature class is not even created, never mind blank. 2. If I use GEODATABASE_SDE writer, I get the following error in FME, which also fails the translation: Unable to create the table/feature class TUN_MN_TEST. When writing to a pre-9.2 Enterprise Geodatabase, a value of 0 is not appropriate for the GEODB_XYSCALE. Specify a number greater than 0 A fatal error has occurred. Check the logfile above for details What makes this case even stranger, is that I got option 2 to work once. Without changing a single thing. It actually created the feature class and everything seemed fine, and whe
Hi, I had a workspace with a personal GDB reader. Recently, our data has been migrated from personal GDB to file GDB. With same database schema, is there a way to just change reader's format in a workspace? Thanks in advanced!
Hi, I try to do a very simple translation AutoCAD to AutoCAD (no transformers, just a change of version). everythings works fine except that the blocks are not translated, even if I include the reader file as template for the writer. Does any one has a solution ? I want to obtain the same structure as the original file... Thank's in advance
Hi guys, I have a WMS running on FME Server which is basically taking an image of an area, cutting out a small user defined area and returning it to the user as a png file. The question I have is related to changing the bounding box in the URL request, when I change it I still get the same map as in the original workbench I uploaded to Server. I am sure it is something simple I have missed and any help would be much appreciated so thanks in advance.
Hello, I have points on many file on a side. On the other side i have a directory with multiple cad file each cad have 1 boundarie I make a workspace with a buffer/clipper and a reader to read all points. I don't want to insert each boudary and insert writers with the same name. I want to scan the directory for cad file, For each file this write a csv file with the point. All of this work perfectly for 1 file but is a way to make it for each file ?
Hello, I got GML file trough translation of SQLServer Spatial into GML, but I can not inspect it, or open it to graphicaly see features. XMLValidator passes the file against schema. Here is a link to my resulting GML file: https://drive.google.com/file/d/0B8kUf-xMW81XY09lV2prQ3VUVlE/edit?usp=sharing
Reader 1: Excel Data with a County column Reader 2: Ownership Parcels for Northeast United States with a County column I want to filter out all counties that are not listed in the Excel Data. This will greatly reduce processing time since the Excel file never has more than a 100 records daily. While the Ownership always has millions of records. If today's Excel Data has County A, B, and C then I only want Ownership Parcels that are in County A, B, and C. I hope that makes sense. What's the best way to filter the Ownership Parcels with the everchanging Excel Data by the county field in the Excel Data?
Hi All I have made a FME script that loads data from an SDE Oracle database and from various csv files. The dat are manipulated and finally summarize in an attribute as a text in XML format . Finaly the text is written to disk using a text writer. This script has been running in a weekly batch job succesfully until 2 weeks ago. Since then, when the script is run in batch or in the workbench, as soon as the writer attempts to write the the text file, a windows message appears saying that FME.ex stopped working and needs to close. After that another error appears with a runtime error. When I run the script in the workbench the last lines in the logwindow are like this. unable to realloc 73638411 bytes This application has requested the Runtime to terminate it in an unusual way. Please contact the application's support team for more information. i = 72 String http://www.safe.com/fme/xquery/functions is still in the pool Zorba Internal Fatal Error in ..\..\src\store\naive\string_pool.c
Good morning, I am using SQL Creator to query a table in SQL Server. This table has about 45M records. My VPN only stays connected for 24 hours, and my workspace needs more time to run. Last night, I was up to 27M records written to text. In lieu of starting over, I was hoping there is a way to run the workspace again, but exclude the 27M records already written. There is a unique field in the table, so it would just be a matter of excluding based on that one field. I cannot figure out how to do this. I do have a list of the unique IDs that were already written in a MS Access database table. Is there a transformer that would allow me to do this? Thanks! Erin
Hi All, We have received a number of cases in support recently where a Geodatabase_SDE direct connection to an enterprise Geodatabase sitting on SQL Server has failed due to the inability to load the client libraries. Once we have determined that it isn't related to a 32 bit vs 64 bit issue the problem manifests as either the error message "fme.exe - System Error The program can't start because sdemssqlsrvr102.dll is missing from your computer. Try reinstalling the program to fix this problem." or "Could not open the Enterprise Geodatabase. The error number from ArcObjects is: '-2147155644'. The error message from ArcObjects is: {Cannot connect to database because the database client software failed to load. Be sure the database client software is installed and configured correctly.} " In all cases these workspaces also contained a reader/writer that was accessing some other Microsoft format - e.g. Personal Geodatabase, MS SQL Server non-spatial,
Hello, I am working with DXF files which are outputs from Leica GPS units. When I bring the DXF into FME as a reader it displays the point data and attributes as seperate individual features. What is the best tranformer to use to combine these into one point feature with an attribute from each one. My goal is to end up with a point feature in a file geodatabase. Thanks in Advance
How can I use the HTTPFetcher to download pdf documents from a URL? I have successfully managed it with Images using the Imagefetcher and writing to JPG, but what do I do for PDFs?
I have a large CSV and apparently FME tries to identify the column type when a CSV reader is added to a workspace. I believe this is causing a failure in a writer when FME identifies a column as "number" but there are a few null values in the column. It appears the CSV writer crashes when it wants to write a "number" but the value is "null". How do I get FME to stop identifying columns that have null values as "number"? I am doing no calculations on this column; it just needs to get pushed through to the writer as it is found in the reader. As a last resort (although painful) how do I change the column type manually to successfully deal with null values?
Hello, I'm translating MS SQLServer Spatial to GML file by mapping SQLServer views I created for translation. But I have one problem. I need to have something like this (just an axample, not real code): FeatureMemberCollection FeatureMember Town School Class ... /FeatureMember /FeatureMemberCollection But I have FeatureMemberCollection FeatureMember Town /FeatureMember FeatureMember School /FeatureMember FeatureMember Class /FeatureMember FeatureMember ... /FeatureMember /FeatureMemberCollection Because of this my xslt creation goes wron way. What can I do, or where I'm wrong?
I have to download images which are made accessible using a password protected api interface. Using the following URL I can retrieve an xml dokument showing the element id´s which contain image data: https://www.THESERVICE.com/api/media-get.php?&user=?????&pw=?????&crs=EPSG:4236&version=current&bbox=9.3131,52.5912,10.2535,53.2265&type=1 From the list, I can then call the images using the following query: https://www.THESERVICE.com/api/medium-file.php?&id=73298&user=?????&pw=????? Could anyone offer a way to enable me to download all the images to a given directory and rename then according to the id?
Choosing a particular layer when converting CAD file to ESRI feature class, I couldn’t figure out how can the end user choose a particular layer when converting CAD to feature class. It appears the “feature type” can’t be set as “user parameter” Then how the user can select a particular layer when converting CAD to feature class? Thank you Best Jamal
I'm getting the following message: CSV Reader: Invalid schema directive value 'number<comma>15<comma>0<comma>number<comma>4<comma>...The expected syntax is SCHEMA <typename1>,<width1>,<precision1>,...<typenameN>,<widthN>,<precisionN>. Using schema scanner instead As you can see, no typenames are being furnished. This happens reading a pipe- or tab-delimited CSV file. User Attributes are parsed and assigned correctly when opening the reader properties, so I don't understand the error. Also why all the <comma> indicators instead of a literal ','? Later on, I'm getting many attribute could not be written errors associated with certain attributes. The containing feature has been dropped...outputs, writing to a file geodatabase as a dynamic writer. Where can I go from here and/or what am I doing wrong with my simple csv -> file geodatabase translation?