Using readers and writers to extract and load data.
Recently active
I wish to add a blank line for every 'x' line in an Excel spreadsheet createt in the FeatureWriter. Any help or guide on how to do this? Thank you!
Hi all, I have a question concerning the output format of a tool on FME Server. Tool runs fine: input contans a DEM-layer, output contains a ZIP-folder including a .dwg-file. There is only one problem: I manually have to add the extension .dwg at the end of the file name, in order to open the file as a .dwg. Right now, the output file has no extension given after extracting the ZIP-folder. After adding .dwg to the file name, the file is correct.Anyone having a suggestion?
Hi,I have 10 building and 10 JPEG files, each JPEG is specific to the buildings .Physical path of the JPEG is configured in the attribute called "path". I need to apply textures based on the attribute "path" . How can I achieve this? Regards,K.Jayakumar
Hello,I periodically load the latest version of topographic data (shape format) from many municipalities in our GIS system. The data is loaded per topographic object (for example: a workbench for buildings, an other workbench for roads, ...). Each workbench loads the data for all municipalities together. The first time the data was loaded the source contained 94 shape files (94 municipalities). The second time this was 92 (9 old deleted and 7 new added). I have adjusted the change in the data manually (update features and connect the new ones), a work that does take some time. Should the number of municipalities change again next time, the reader must be updated again. Is there a possibility to automatically read all shape files (which can change in number and file name) in one and the same folder, without the need to make manual adjustments? Thanks!Luc
What I'm trying to achieve is to write data to hosted feature layer on ArcGIS Portal.In Esri ArcGIS Portal Feature Service writer parameters I'm using this template: "Host" - https://myarcgisportal.com/arcgiswebadaptor/, and tried all options and accounts in "authentication type" - "Generate token", NTLM, Kerberos and both domain and ArcGIS accounts (ArcGIS Portal admin), it shows "the server at https://myarcgisportal.com/arcgiswebadaptor/ does not appear to be an ArcGIS Portal Instance". Portal is federated with server and ArcGIS Data Store is configured. Maybe something is misconfigured on Portal?Any ideas would be much appreciated.Thanks!
I have a large number of dto's created within Mercator which I can not read through the MCF Reader. I get the following error message Error - Invalid data in file 'dto_test_notworking_t.dto'Closing input file 'dto_test_notworking_t.dto'MCF_READER_PIPELINE::f_1(SortFactory): Done sorting 0 feature(s)Error - No bounding box coming out of the pipelineA fatal error has occurred. Check the logfile above for detailsFailed to specify the feature index as constraints on the reader I also have a dto file that will read through the MCF Reader. I have tried to compare the structure of both files but the file produced in mercator seems significantly different to the one that will read through the Mercator MCF Reader. Does anyone have experience with this data type and can identify what is wrong with my data ? Sample attached. Thanks Ciara
ArcGIS Online Feature Service Writer: Could not connect to server. Check that you are connected to the internet and that no firewall is blocking outbound connections. The error was '("Connection broken: ConnectionResetError(10054, 'An existing connection was forcibly closed by the remote host', None, 10054, None)", ConnectionResetError(10054, 'An existing connection was forcibly closed by the remote host', None, 10054, None))'
Is it possible to download a PDF file and then write that data to an MS SQL table? Any help would be greatly appreciated!I am able to download, using the below. However I am not able to write to SQL as VARBINARY(MAX).Almost there....
Hi, I am using S3ObjectLister and S3Downloader to connect to a bucket, download data and process it. I have two bucket setup in two different regions (ap-southeast-2) and ca-central-1. When I use settings for first region it works fine but when I change settings for region 2 i.e ca-central-1 (which is not available in transfomer's region drop down) S3ObjectLister rejects to connect and gives me follow errorsfme_rejection_code: ERROR_CLIENTfme_rejection_message: fme_rejection_message (encoded: UTF-8): Not able to determine region for ca-central-1.Please upgrade to a newer version of the SDKI am not sure how to access bucket setup for ca-central-1. I have tested bucket setting and it is responding well and tried using different regions with with bucket setup for ca-central-1 I get different error code 301.
I'm reading an XML with ticket details that has xsi:nil=true in the tag and it adds the field name with .nilAlso,there is a tag with xlmns andIm not sure if I have to use a List Exploder to further get its attributes.I'm a novice FME user and have no prior experience with xml eitherI'm looking for direction on how to resolve the field names to be the tag text and populate its values in ESRI Gdb formatAny help will be much appreciated
Hi! I have a workspace that converts LAS into Recap using a pointcloudlasclassifier before writing out to Recap. This workspace runs 100% flawless on desktop. When publishing to FME Server however, the workspace always fails the first run after logging into a new session in the browser. When running the workspace the second time (and following runs) without editing any parameter it runs successfully. Any ideas what can cause this issue? It seems that it is the rcs-files (which are written to a subfolder) that is causing the workspace to fail.
Hi,I use FeatureWriters in FME Workbench 2017 for inserting datasets in Postgres.But when there are errors in my input data, like a string instead a boolean value, the row is not written in Postgres but FME doesn't detect the error, the row is counted like a correct insert and I have the message "Translation was successfull" at the end. Of course, I could use AttributeValidators to detect such errors but I have a lot of fields and I wouldd like to avoid to inspect each field. Thanks in advance for any help,Christian
Hi,I’m having problems with SDE writer with a “Versioned Edit Session” transaction type in my workspace. The workspace in question is initiated by Workflow Manager. A child version is created in our flow and the name of this version is passed along as parameter value. I’m using a writer, with three feature types, with the following settings: What do I expect:The data is written to the child version. If writing to the tables succeeded, then the child version is reconciled and posted to the parent version. After posting, the child version is deleted. When the writing fails, the child version is not posted to the parent and is automatically deleted. What do I have at the moment:The data is written to the child version. If writing to the tables succeeded, then the child version is reconciled and posted to the parent version. After posting, the child version is not deleted. When the writing fails, the child version is not posted to the parent and is not automatically deleted. The followin
Is there a way process OSM data so that I organise the most important tags into separate attributes while keeping all other key/value pairs e.g. by dumping them into another attribute called "othertags"?For example; an entry in my Highway table might look like this:highway trunk lanes 2 oneway yes width 12 othertags "surface"=>"asphalt", "name"=>"Ermine Street", "maxspeed"=>"70", "lit"=>"no", "ref"=>"A1", "name:en"=>"Ermine Street", "maxwieght"=>"..... Basically I don't want to lose any info, but I don't want to expose all tags to potentially several tens of mostly useless attributes.
Hello,I'm migrating some shapefiles using FME to a PostgreSQL/PostGIS database. Is there any way to monitor all of the SQL commands that have been sent to it during the translation ? Thank you.
Hi all.A problem that makes me crazy :-(To collect data form Oracle, I use an SqlCreator with a parametric query.When I run the same query in SqlDeveloper, I takes the correct number of records. Usually a single record.When I do the same in FME, the record is duplicated.The strange thing is that if the correct result is one record, it is duplicated. So two records.If the correct result is three records, the result is four. One duplicated and the other fine.The production landscape where the problem occurs has two FME servers with distributed engines.In the second landscape (testing), the problem doesn't happen.Very strange...Thanks for your supportRoberto
Hello everybody, I have to solve urgently problem with generating of SVG files. I still cant find way, how to define title of SVG file and also, how to insert my attribute after <g id> tag, see pic below? Please, do You have any tip, how to figure out this problem?Thank You so much!Lubo
I have ifctoCityGml template (no idea how it is working) and its working fine and convert my ifc to citygml but the only problem i am facing is that it is not exporting roof while it successfully exported WallSurface, FloorSurface and window. And here is its transformation snap:As you can see there is no output from FeatureMerger_2 Transformer. I guess Merged, is not producing any output.
I have an excel file containing 100,000 items placed in 700 boxes. The file has two columns, one column is the item and the other is the corresponding box. I would like to get them rearranged as a file with 700 columns and each column (box) has all it's corresponding items listed underneath. Attached is an example: Excel's Pivot table and FME's AttributePivoter are asking me to group the items by columns AND rows. But I don't have rows to group the items with. I just wanna group the items by columns.
I like to have a simple shapefile been written to CityGML.A simple task, I assumed, but it doesn't work out the way I want... at least, not in the end.The color and the transparency don't come with the CityGML file. What am I doing wrong or what am I missing here?Attached the Workspace and the data.
im trying to know if a feature is empty or not, iv tried a counter box butit does'nt do the job (but the counter receive no input).
Hello everyone, I'm getting a Python error when trying to add a ArcGIS Online reader. I noticed this today, but can't say for sure when exactly it happened. I'm getting this error in the console log:Creating reader for format: Esri ArcGIS Online (AGOL) Feature ServiceTrying to find a PYTHON plugin for reader named `ARCGISONLINEFEATURES'Loaded Python module `arcgisonlinefeatures' from file `C:\Program Files\FME\plugins/python27\arcgisonlinefeatures\__init__.pyc'Python Exception <ImportError>: No module named arcgisonlineCommonCould not create Python Reader `ARCGISONLINEFEATURES'A fatal error has occurred. Check the logfile above for detailsFailed to open the dataset '<Unused>'DATASET INFO:  DATASET: <Unused>  NUMBER OF PARAMETERS: 3    RETRIEVE_ALL_FS_NAMES = Yes    NC = envita<space>gis<space>Esri<space>ArcGIS<space>Online    _MERGE_SCHEMAS = YESSo it's complaining about the arcgisonlineCommon module, but I don't
Hi,I'm writing to a MapInfo extended tab, and noticed there is a delete operation on the tables. I have tested this out, and have got it to work, however the tables aren't compressing after and the deleted records are staying in the table albeit flagged for deletion. A pack of the table solves this, but cant it happen on closure of the writer?Cheers,James
Hello everyone reading this. I am new to gml conversion, so I seek help here.I am trying to read gml files provided with xsd schemas, validate them, insert those data into PostGIS database, do some database processing, then exporting data from database into gml files using same xsd schema (meaning output file should be more or less copy of input gml file, with less or more features)Importing gml files into PostGIS database is going fine, however I have several problems with exporting data, as the files differ in several places and I am unable to figure out how to duplicate the structure.Unfortunately I cannot provide xsd file and have to use modified gml, sorry :( I have several problems:gml file looks like this (change extension, website did not allow me to upload gml):1) FeatureCollection attributes.snippet of xsd:<xs:element name="FeatureCollection" type="eczr:FeatureCollectionType" substitutionGroup="gml:AbstractGML"/> <xs:complexType name="FeatureCollectionType">
The reader in my workspace is an ESRI shapefile. I am clipping this to a buffer, changing coordinate system (SnakeGrid) and writing to a MicroStation .dgn. I am copying all the attributes from the .shp and writing as tags. Can I do this for several .shp's at once and it only carry the necessary attributes for each .shp? When I input '*.shp' to read all .shp in a folder, it outputs then individually but with the attributes of all the input shapefiles.