Using readers and writers to extract and load data.
Recently active
Hi. I am trying to batch processs for the first time. I want to do a batch run translating a few hundred shape file segments into DWG, but my batching does not work with the DWG writers, it stops after translating the first shape file. The batch deploy works fine if I replace the cad writers with a shape writer, it outputs several shapefiles with the transformer attributes. I have merged the feature types using a * wildcard in the reader. Even if I remove all transformers from the workspace the DWG writer batch also fails, it just outputs the first file and then stops. If I load the workspace in the quick translator it doesn’t give me an option to output files into separate directories, I can only find this option for translations created from scratch in the quick translator? From some other unrelated map files I tested, batch deploy works shape -> DWG and shape -> shape without any problems but not shape -> DWG (even going backwards with the same dataset).
I want to set hatch layer fill colors which are defined by number values in the attribute “extended_data{1}.32Bit_integer{0}” (this option is not in the DWG styler), and I would like to edit the values of the data_list and extended_data attributes for a large number of map material that I am going to import. Most of these DWG-attributes from CAD are removed during transformation. Is there a way to add, keep and set these attributes in FME? Directly adding them as user attributes did not get recognized in the writer. The single “autocad_extended_data_list{}” is present as a format attribute but nothing else.
Dear FME community, if I add an access writer, FME asks me for a file name, of course :). This name is then displayed in the Navigator window, e.g. "filename [MDB_ADO]". The feature type corresponds to the table name, like in an excel writer. If want to add another access database with different attributes, I always have to add another writer (not feature type!). In difference to for example the mapinfo writer where the feature type corresponds to the file name, in access/excel it only refers to the database/table name. What I want to do is use the existing (one) writer and just add another feature type. This would have the advantage that if I change the directory, I would only have to change one path in one writer, not in every access writer. Does anyone know who to handle this? Kind regards Thomas
The workspace I am using , reads a FGDB and writes to FGDB. To write to fgdb, a workspace uses schema exported from source fgdb as a template. In this way output fgdb will comprise all feature classes (with and without features) as well as a inherent topology from source fgdb. The flaw here is writing a topology too. This is something we do not want to. The advantage is writing feature class although it is empty. If I avoid to use schema in order to create a fgdb with the same structure, and use option 'Impory feature types' from Writer, the result will be no topology (as wanted) and all feature classes except these which are empty. Thus, If there is no feature written to fc, then this fc won't be written. This in an unwanted result. The same situation is by using dynamic writer too... To summerize my needs: no topology and all fcs have to written (regardless whteher they are empty or not). Maybe this topic is very trivial to someone, but I am stuck on it.
Hi, In FME Server documentation there's a whole chapter describing FME Server config files and where to find them. But if I'm using FME Cloud... where do I find them and how can I modify them? Thanks!
Hello, I have a question according to the CityGML reader in FME. E.G. I have two attributes "Class" and "Function". In my example there is no "Class" attribute in the file. Therefore, in FME the attribute related to class exists but is <missing>. The second attribute I have is" Function". It exists in my CityGML file but not valid(there is no value)! <bldg:function></bldg:function> Now, I am trying to find such attributes which are empty but the problem is in the case such as function, FME gives <missing> as value and neither null nor empty. My question is, why does FME treat both of the cases in the same manner "<missing>"? and is there any way to distinguish these two different case? I appreciate your help in advance. Best regards, Mani
I have a fairly simple job that reads a directory on our network and finds a specific shapefile. there are different shapefiles in this directory (but I only want one of them) and the data is not ours, it's produced by another group. So we cannot dictate to them to place the data elsewhere. My FME Desktop job goes to that directory and reads the shapefile they produce. The job works perfectly when I run it from Workbench. Here's the issue. I want to publish a job to FME Server and have it run nightly. The only issue I have is I don't want to have to upload the shapefile every day. It defeats the purpose, because I could just manually run the FME job in Workbench daily to do my update. When I publish the job I just don't know how to tell it to go to a certain path on our network and find the shapefile. To make matters worse there are spaces in the shapefile name and there are some spaces in the shapefile path. Here's the path: K:\\Geology\\Discovery Projects\\Ut
Hi Everyone, I have a generic reader and it is writing to Oracle Spatial 11g as a dynamic schema. I'm having an issue with my reader opening the datasets in a folder I tell it to look in. What's happening is that it tries to open the .dbf file as if it is the .shp file and then on consecutive runs it will try an open .TAB files as if they are .shp files. Even if I change the "Feature Types to Read" parameter I still get issues with both .tab and .shp files. If i specify that FME should read the specific file instead of looking in a folder for them then it works. It is as if FME just finds the first file which matches the name of the feature and tries to read it as the .shp file instead of looking in the folder for the file with the extension .shp and using that. Could I get some help with this? Even some confirmation from other people who can replicate the problem. I'm using FME Desktop 2014 SP2 build 14339 - win32 Thanks
Hi, How to Configure Temporary directory for MFE Server Engine : i just want to change from C: to D; drive , currently FME server is cofigured on `C:\\Users\\username\\AppData\\Local\\Temp\\fmeengines\\Engine1
I have a text file which represents a log of activity in using a software licence. The license server records each issue and return of the licence on a seperate line of the file. Every day, an entry in the file reads something like "DATESTAMP: YYYYMMDD" Then there are a series of lines which read "TIMESTAMP: HHMMSS" What I want to do is associate each timestamp with the latest datestamp to appear above it in the file, and create this as an attribute on each timestamp feature. Does anyone have any suggestions? Thanks in advance, Riley
The writer is failing and the log shows this: Google Maps Engine Raster Writer: Google Maps Engine responded with HTTP 400 and error message: domain:global message:Access lists are deprecated and are not available for use in new Maps Engine accounts. Remove any draftAccessList or publishedAccessList fields from your request and try again. reason:invalid =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Feature output statistics for `JPEG2000' writer using keyword `W_1': =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Features Written =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- nurc_mosaicnurc_mosaic 1 ============================================================================== Total Features Written 1 =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
Do the FME text / csv writers have the ability to save each record that gets sent to them? I am running a process that will retrieve about 200,000 records. From my test results it appears that FME only writes to the file when the process completes. But since this process will take a few days (I have a decelerator in the script) I don't want the script to choke part-way through. It would be better to save each record that arrives at the writer. Thanks
Hello, I have a number of 3D-buildings saved in a multipatch layer in an ESRI file geodatabase. These buildings are saved with unique object ID-numbers and a few other attributes. I need to create a FME workspace that reads these objects, and outputs them as object groups in a skp-file (local coordinate system, Sketchup 2013). I have created a workbench that reads the multipatches and writes them to their own layer in a skp-file using the GeometryPropertySetter and a attribute called "sketchup_layer_name" (="Buildings"). But, instead of being written as sketchup groups (i.e. a group of surfaces that equals a multipatch), each surface from the multipatches are being written as separate faces. I am able to select all the faces that belong to a certain building, rightclicking them and clicking "Create Group", but since I am working with severeal thousand buildings I need a way to automate this process. Any help is greatly appreciated :).
Can FME Server 2014 work with workspaces created at FME Desktop 2012?
Hi, I am very new to xml and when I want to open my xml file, I have a reader in navigator but no feature types appear. In log file I receive this message: <R_1 Reader> - No GML features were found in the set of XML Schemas, make sure that at least one of the schemas is a user, domain or community-specific "GML Application Schema". UniversalReader -- readSchema resulted in 0 schema features being returned Reader Parameter(0) = >C:/Users/TEMP.GIS.000/Downloads/codelists-1.0-examples/codelists-1.0-examples/BuildingFuctionType.xml< Reader Parameter(1) = >MAP_EMBEDDED_OBJECTS_AS< ....... UniversalReader -- readSchema resulted in 0 schema features being returned .... What I need in my workspace is to have the building types and their values for further work. <dictionaryEntry> <gml:Definition gml:id="id21"> <gml:description/> <gml:name codeSpace="urn:d_nrw_sig3d">1000</gml:name> <gml:name>
How do I create a smallworld dataset from shapes files?
Hello! I'm curious if there is a way to strip away the feature dataset information when using an ESRI file-geodatabase writer (GEODATABASE_FILE, dynamic mode)? My workbench reads a series of layers from an SDE database, performs some geoprocessing and then writes all the data to a new file geodatabase. I'd like to remove the feature dataset names which come from the SDE and output the layers in the root of the fGDB. Any suggestions? Thanks in advance, ~jess~
I am having a problem similar to https://safecommunity.force.com/CommunityAnswers#!/feedtype=SINGLE_QUESTION_SEARCH_RESULT&id=906a0000000Ce4vAAC When recently using FME 2014 i must have unconsciousely switched from using the Mapinfo (MITAB) writer to the new MapInfo (MAPINFO) writer. I recently discovered that files i had created would not open in version 11.5 of MapInfo, giving me a message saying that it would only open in v12. This morning I discovered that using the MITAB writer works ok. This is important as I deal with people working on versions 7 - 12. Please can someone explain the difference. I have never known a TAB file to be fussy about what version it was created in before. I can only find documentation on the difference between the MFAL and MITAB writers Thanks
Previously you could choose for instance C:\\temp\\input.pdf on FME Desktop and then tell FME Server that this should NOT be changed (ie, the files are still located at c:\\temp\\input.pdf) on the Server. With FME Server2014 I can not seem to get this to work. Even when using the DO NOTHING parameter on the Manage resources when uploading. Is this a bug? What is the workaround? FME Server 2014 - Build 14235 - 32 bit win, same FME Desktop version, 32-bit
Hi, I have a large amout of data in csv files 4 mil in each. Always gets memory problem when reading the data. The rest of the process is fine. I use a 64 bit fme on a powerful machine and the memory is only on 60%. Any suggestions? Henrik Rinne
I have a CSV output file which is currently 54mb. I need to upload it in a system which has a limit of 5mb. Is there a way of limiting the writer to 5mb limit and then write to another CSV. i.e. I want to get 11 csv's of the same data. Ideally with a counter in the name i.e. upload1, upload2, etc. Is there a way of either setting a writter parameter or a transformer to do this?
Hi all, I have a question. and one problem! I have a CityGML file with lots of generic attributes. On the other hand I have CSV file containing all these generic attribute names and their values. What I need to do is a validity check for these generic attributes. Like if all obligatory attributes are given as generic attributes and if the assigned values are in the range. My question is: Is it possible in FME to filter feature's attributes based on attribute names like having only those attributes which do not contain citygml in their names?! My problem: I am going to write a citygml file into CityGML ADE-inspire. (I have the schema for the ADE) My problem is regarding the nested feature attributes. I mapped every things correctly and when the output is redirected to FME inspector the results are OK but when I need to write it in a gml file the inspire attributes (list ones) are missing. Example: In attribute creator I have: core3d_inspire_id{0}.base_identifier_base_namespace
I am writing features in a PostgreSQL database. Everything seems OK except for the following warning... INFORM|Truncating existing table 'public.user_locations'... INFORM|Appending to existing table 'public.user_locations'... WARN |PostgreSQL connection: Unknown type with OID 24635, treating as char(-1) What does that warning means and what should I do to get rid of it? Since I am about to load hundreds of GB of data, I just want to be sure everything will run smoothly after the upload...
I've made a workbench witch project some geometry with EsriReprojector. It work very well on my desktop (FME 2013 SP4 build 13547 WIN32) but on the server (FME Server 2013 build 13547 win32 on a Window 2008 R2 Enterprise x64) it crash without any log (with the exact same geometry). Any help will be appreciate !
Can an FME server host any map services (e.g. OGC's wms services)?