Using readers and writers to extract and load data.
Recently active
Hi, Using FME I want to copy a set of files in 1 directory to a different and then add a new file extension (whilst retaining the old). I have created a workflow which works by reading all files within a directory, I then use the AttributeExposer, FilenamePartExtractor and StringConcatenator to obtain the details of existing filename and also create the new name. I then use a fanout on the text writer to output to the new directory. The problem is that I think it is inefficient as the contents of the files are being read in and then processed, when this only needs to be completed at file level and not contents level. The input files are essentially text files from a mainframe, and named as user id and mainframe report output number, i.e. asd0122.012 asd0122.013 asd0122.014 I am keen to retain the existing 'extension' as this provide information of report request order and therefore want to produce the following asd0122.012.txt asd0122.013.txt asd0122.014.txt I imagine th
Hi. I'm trying to get my FME workbench to read an excel spreadsheet that is automatically generated and has an asterisk in the column header of two columns. It reads this and displays it in the drop down list of attributes, but when I connect an inspector straight to the reader (I'm trying to get it to ignore a title line) It wont read any of the columns with asterisks. They're not empty theyre just not there. Does anyone know why this is or if there's a workaround? I've tried creating a copy of the file, deleting the asterisks, pointing to that, then adding them back in but of course the workbench then cant find the columns. Since its an automattically produces xls file, I can't edit it manually everytime so what I need is for the FME workbench to ignore the title line and read all of the attributes as they are. Thanks
Hi, I have a workspace that reads features from Oracle, does some processing, and then uploads back to Oracle. I'd like to name the feature that is written back to be the same as that which was read but with the date appended. Is this something that possible? Thanks for your help
Hi, I have a table in Excel as in Fig. how to arrayed all numbers in the second row?
I have a versioned ArcSDE annotation feature class in prod SDE database. It is to be updated from an unversioned annotation feature class in the staging SDE database. The staging annotation feature class will be built from scratch each month. The staging and the prod have the same attributes. The production is versioned because it is slightly edited and also archieved in ArcSDE. I can't think of a way to do this update in FME. I can use fme_db_operation and "Write Mode = UPDATE", but there is no common update key fields between the staging annotation class and the production annotation class. I tried using "TEXTSTRING", but it does not seem to work.
Hi all, Just upgrading to the pro edition, and what a edition! :) Using the WFS reader to update a table in our local database (postGIS). So far so good. I want to run the workspace as a batch updating the table every night, which means I want to delete the content of the table before updating it. Somehow this dosen´t seem to work. I tried to google the answer, setting the parameter in the postGIS writer to UPDATE. Not working. Something I´ve missed? I´m using FME 2014 SP1 Christian Link to Workspace screenshot: https://dl.dropboxusercontent.com/u/8365323/WFS%20%E2%86%92%20POSTGIS.png
Hi, I'm currently using the new ArcGIS Online Feature Service writer. It does write something, but the problem is that it doesn't create a Feature Service but it writes a (downloadable) shapefile on ArcGIS Online. From the webinar http://www.safe.com/webinars/how-to-leverage-arcgis-online-with-fme/ (http://www.safe.com/webinars/how-to-leverage-arcgis-online-with-fme/" target="_blank), I was under the impression that this should actually work: it seems to create an actual feature service there. I am writing to ArcGIS Online as a Publisher. According to ESRI's documentation, this user type should have privileges to create a feature service. Does anyone have any suggestions about this? Thanks, Sander
Hi Everyone, I just recently upgraded from FME Desktop (32bit, windows7) 2014beta to 2014 SP1Beta (build 14277). I have a few translations that are run daily and they use the Google Fusion Table (non spatial) reader to take in records and then add records. I know this translation was run after we upgraded and it worked, then about a day or two later the log entries stop (in the fusion tables) and today I get a report that the translation is failing. I tried resetting the reader and writers (as this has helped in the past with fusion tables), but I get to the point of refreshing the token (goes fine) and then I go to the 'Table List' [...] icon and it cannot establish connection to get the table list... this repeats no matter how many times I press it. This is after token successfully refreshed: Then I try to get table list: Show Log: I have tried this on another system with FME 2013 and I also get an HTTP error, but I am not sure if this is due to the fusi
Hi, i have dgn with text 28 362 49 5036 in one layer, and i need to get four layer, so number 28 goes to layer 1, nuber 362 goes to layer 2, number goes to layer 3, and number 5036 goes to layer 4. Have any idea? TNx
Hi everyone, I have an issue with a DGN writer where it's not outputting text. I have generated text using the LabelPointReplacer which successfully outputs the Visualiser however, when I write to a DGN it doesn't write out. The workspace uses a few tricks to get a work-compliant file. I've taken the company DGN seed file, attached in the levels I want and made this file the seed file for the DGN writer. I've used an AttributeCreator to get the data to write out to the correct DGN level and then the DGNStyler to colour by level (also set line weight and style by level). I should add that when a cell I've called into the workspace via another DGNStyler passes through the process above, it plots, but the text does not. I have a feeling I need to expose something text related on the Writer or perhaps FME is generating a font that isn't in the writer seed file, but not sure where to look. Any help appreciated as always. Cheers! Amit
Hello, I´ve a little problem. I have latitude and longitude coordinates in decimal degrees but i need them with decimal values in EPSG:32717 (UTM-WGS84 17S) for x and y. x=667876.12 and y = 1234564.345 for example How can i do this? Thank You
Hi, Is there a way that I can get hold of and use the results from calling a stored procedure in a SQL Executor? My procedure seems to run fine, but I haven't been able to get anything out of the Result output port of the SQLExecutor. The stored proc queries a mapping table and returns either an existing id or a newly-created one (or an error). My SQL looks something like this: declare ID number; STATUS number; ERRMSG varchar2(128); begin schema.get_new_id(@Value(obj_id),'@Value(table_name)',ID,STATUS,ERRMSG); end; Again, it seems to run fine, but I would like to use the output variables ID and STATUS on the feature farther along in the workflow (e.g. to set an attribute value). Any assistance is appreciated. Thanks!
Hi all, A lot of work has been done in FME 2014 to improve the handling of null values in attributes in the various Database formats. We are now ready to have customers test this functionality and let us know of any issues that they run into. Full details of the new functionality and the formats which support it are available here http://fmepedia.safe.com/articles/FAQ/Does-FME-support-nulls. If you are interested in testing this new functionality the latest FME 2014 beta is available for download from http://www.safe.com/beta. We are interested in any feedback you may have when running existing workspaces in FME 2014, e.g. any changes in behaviour due to the addition of the null attributes. And then any comments on the new options within some of the transfomers which have been modified for FME 2014. Please send any comments to support via our webpage at http://www.safe.com/supportrequest. We look forward to hearing back from you. Kind regards, Robyn Rennie www.safe.com/
Hello, my problem is to read a CSV file without field names. You can find the images mentioned in the error description in the folder "Screenshots" . It read and process the file " Importbeispiel_100_Adressen.csv " successfully. I use the parameters as shown in the screenshots "csv_parameter_1.jpg" and "promt_and_run_1.jpg". The expected result ("_target_url") is correct: "http://fvs72.lgb.local/gdigeokoder/RestService/GeokodiereAdresse?key=zgnsjf&str=Milmersdorfer%20Chaussee&hn=25&hne=&plz=17268&ort=Ahrensdorf&ot=&srs=EPSG:25833" If I want to read the file "Importbeispiel_100_Adressen_oue.csv" (see "promt_and_run_2.jpg") it does not work. The "_target_url" can not be properly generated: "http://fvs72.lgb.local/gdigeokoder/RestService/GeokodiereAdresse?key=zgnsjf&str=&hn=&hne=&plz=&ort=&ot=&srs=EPSG:25833" I suspect the probl
I have a 4 band TIFF image (RGBa), where the "a" band is the near infrared band. I need to create an RGB image from this where the "a" band is mapped to the Red channel, the Red band is mapped to the Green channel, and the Green band is mapped to the Blue channel. This would create a "false colour" RGB image that enhances the vegetation. I'm pretty sure this can be done but I don't have much experience with Rasters and FME. Any help would be appreciated on which transformers to use. thanks
There has to be a way, but I can NOT find it. But I have over 500 transformers in my workbench and need to search for readers and writers that appear in the catalog tree on the left. How do i go about doing this? When I do a normal search it just highlights the catalog tree??
I'm unable to use an Esri Geodatabase (ArcSDE Geodb) reader to connect to a SQL Server SDE database. The error I receive is: Could not open the Enterprise Geodatabase. The error number from ArcObjects is: '-2147215997'. The error message from ArcObjects is: {Version not found ["STATE\\CW0157".sde:DEFAULT]} Please ensure the connection parameters are correct (server=`myhost', instance=`sde:sqlserver:myhost\\myinstance', user=`STATE\\cw0157', password=`***', database=`NHD', version=`sde:DEFAULT') I can successfully connect with these parameters in ArcGIS Desktop and can even use the Microsoft SQL Server Spatial Reader to connect (but connecting this way isn't ideal because of other issues). Any idea if this is an FME issue or SQL Server issue? Thanks, Michael
Sorry if it's a simple question, but is it possible to specify that a Mapinfo file written from FME is 'read only' in the parameters? Thanks in advance
Hi All, Quick question, I've some data in .gfo format. I understand a plugin is required to read this data in FME? Has anyone managed to read .gfo data into FME? And if so, can anyone advise if this plugin is freely available or should I be better trying to request some onformation on it from Safe? Google searches have proved futile so far! Thanks, Tony
I have a dataset which consists of multiple Excel files. Each file has four worksheets. I want to merge one of the sheets from each workbook. The sheets all have the same schema, but the sheets don't share the same name. Some of them are named "Table" while other sheets have a name constructed by three digits followed by a place name; 102_Stockholm; 513_London... Setting a regex in the merge filter properties of the reader is no problem. The problem is what to write in Feature Type Name? The Feature Type Name always semmes seems to works as a reducing filter. If set to "Table" I only get the sheets named "Table". I've tried to use some kind of wildcard (*, %) without any luck. Regards, Daniel
Hi there, I have an infuriating problem in that I have a DWG file that looks fine in it's origin, but when I load the DWG into FME 2013 SP3 several elements that compose a block lose their z value. I can see the z values in the DWG but by the time FME reads it some of them have gone. There are no warnings or errors it simply seems to lose the height, any thoughts appreciated...
I want to create a published user parameter to pick an existing ArcSDE version when using Prompt and Run. I found this post (https://groups.google.com/forum/#!topic/fmetalk/uL_N9j9vDW4) from 2011 and sounds like there wasn't an easy way to create a user parameter and was hoping this has changed. Essentially I want the "Choose SDE Version" dialog to open up and the user select the version they want. The screenshot below shows the dialog I'm looking to use for the user parameter (note I removed some info from the graphic). How do I create a user parameter to get the "Choose SDE Version" prompt?
Hi every one, i'm facing a problem while i'm trying to import the .LAZ fiel to Postgres DB. Workbench is showing only 1 feature was written to the database, where as the input file is having more. Log is also not showing any error. The data should be imported to Postgres with the data type "pcpatch". Please help me in this regard. Thanks in advance.
Hi All, I'm not Database Admin and I am getting some help with the SQL queries, but I'm updating a postgres database from values in a google spreadsheet. The values are stored as text in the spreadsheet and postgres but I'm having to use the "quote_literal" in the SQL below otherwise I get a text error when trying to write to the postgress database. The issue is that it does still fail when I use the kind of text in the google doc illustrated in this nice cartoon. Is there a transformer I need to use get FME/Postgres to treat it correctly or is this just a bug in the way FME is talking to Postgres? I'm using the Google Spreadsheet Reader and the SQL Executer to do the work. UPDATE function_program_data_function_structure SET text_data = quote_literal('@Value(fs_10_10_10_10)') WHERE level_id=@Value(id) AND flag_no='10' AND group_no='10' AND group_element_no='10' AND field_no='10'
Hi, I'm wondering if there's a way to expose the hyperlink values from hyperlink defined text from an Excel file? The FME reader shows the values as varchar. If possible, I'd like to convert the values through FME rather than doing in Excel first.