Using readers and writers to extract and load data.
Recently active
Related to my question about importing a prj file, I think one of these might be a solution. My inputs are DGN files and my outputs are shapefiles. The DGN files do not have a projection defined so I thought I can replace the prj file created by the shapefile writer. I came up with two different ways to do this but I don't know what will work in FME. Will one of these work for replacing my prj file?create the shapefiles and save in a fanout by a given attribute (category)read in the source prj filerename the source prj file to match each new shapefile and overwrite the existing prj file, effectively overwriting the one created by feature writer. What transformer will I use for renaming the file and saving it?I already have a process for creating the list of shapefile names, will fanout by the same attribute overwrite the existing file?replace all of the text in the new shapefile prj file with the text from the source prj filethis seems the easiest but I don't know how to read i
Hi, we got a strange message when placing an MSSQL tabular reader on the canvas (FME 2017.1 built 17652). Here is the screenshot (and a detail). Any one any ideas on this one?
I would like to convert OSM building boundary to CityGML LOD 1 format.I am successfully converting into KML or CityGML generic object format but When I am trying to convert to CityGML building by adding citygml_lod_name detail it showing following error.CityGML Writer: The 'IFMELine' geometry is invalid for the 'lod1Solid' citygml_lod_name, valid geometries for 'lod1Solid' are: {IFMECompositeSolid, IFMECSGSolid, IFMEBox, IFMEBRepSolid, IFMEExtrusion}, convertible geometries are {IFMEMultiSolid, IFMECompositeSurface, IFMEFace, IFMEMesh, IFMETriangleStrip, IFMERectangleFace, IFMEAggregate, IFMEMultiSurface, IFMETriangleFan}.Storing feature(s) to FME feature store file `C:\Users\....\osm2ogckml_log.ffs'+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Feature Type: `Building'Attribute(string) : `_uuid' has value `9a3b482d-a204-465f-a73e-e35a6da505c4'Attribute(encoded: UTF-16LE): `building' has value `university'Attribute(encoded: UTF-16LE): `changeset' h
Using FME Server build 18305I am testing the Upload multiple files in the FME Server REST API V3 on my server.The goal is to upload a shape file using the POST /resources/connections/< resource >/filesys/< path > (Upload multiple files) method but getting stuck on using the file due to corruption.These are the settings:The return looks like this:Response Code:200Response Body[ { "date": "2018-10-22T11:09:43Z", "path": "/Testwerk/", "size": 8360, "name": "waterschapsgrenzen.dbf", "type": "FILE" }, { "date": "2018-10-22T11:09:43Z", "path": "/Testwerk/", "size": 428, "name": "waterschapsgrenzen.prj", "type": "FILE" }, { "date": "2018-10-22T11:09:43Z", "path": "/Testwerk/", "size": 170, "name": "waterschapsgrenzen.shx", "type": "FILE" }, { "date": "2018-10-22T11:09:43Z", "path": "/Testwerk/", "size": 960243, "name": "waterschapsgrenzen.shp", "type": "FILE" }]Everything looks OK till now, but when downloading an
Hi,I try to import an Excel file in a Postgres table.But before inserting the rows of the Excel file, I have to delete all records in the destination table where the values of a column from Excel file are matching the values of a field in the Postgres table.I achieved to perform the delete operation with an Aggregator transform that performs a groupby operation on the Excel column and a SQLExecutor transformer that deletes in the destination table all records whose values are matching one of the groupby values.That part works fine.But now, I don't find out how to plug after this the insert operation on a Postgres writer.Because the SQLExecutor returns only the groupby values from the initiator.I don't think I can use a DatabaseUpdater transformer with fme_db_operation for this context.Thanks for any help.
Is there an equivalent reader to the Directory and File Pathnames (DFP) that can take as source parameter a file, or files, including wildcards, and produce one feature for each file, but not actually read in the file. Essentially it would be the DFP reader that can take a Filename (Multiple) parameter instead of just a folder. My current workaround is to use the Text File Reader, whole file at once, but it's reading a bunch of data unnecessarily.
Just want to know if FME can convert Excel xlsb to xlsx format? Thank you very much.
Hi everyone,I'm exporting GIS point data to AutoCAD Map 3D DWG file. On output, I need to have the inserts as blocks and the original attributes as object data. In the workflow, I use the "DWGStyler" transformer with block definition defined in a DWG Template file - original block doesn't have any attribute - and output them in AutoCAD Map 3D Writer with OD.Everything is fine : when I open my output DWG File in AutoCAD Map 3D, I have correct blocks and object data... but block attributes too ! So, I get duplicate attribute information for each object (cf. attachments).This DWG File must be edited by other users and re-import later on GIS, so the duplicated information can be a source of confusion.Is there a solution to insert block without block attributes ?Thanks for help !
Hi, I'm trying to do a simple file format conversion from .IFC to .DWG however i'm experiencing some issues with the snapping points with the dwg output. What is the best way to approach this? are there any tutorials/workspaces that can help me with this?Thank you Jon
I have made a workspace from IFC to COLLADA. However my writer doesn't write a working .dae file when I try opening it i get this message:An error occurred while constructing the geometry with id 'g_1'A <triangles> element with a 'count' of '129' contains an incorrect number of indices i it's <p> elementA fatal error has occurred. Check the logfile above for detailsFailed to specify the feature index as constraints on the readerHow can I specify the feature index as a constraint on the reader? and what does it mean?The <triangles> element with a 'count' of '129' contains 388 indices in it's <p> element, I think it should be 129*3 = 387 indices. If I understand the COLLADA specifications correctly Count specifies the number of indices and p are the indices. But reading COLLADAS specefications are unforunatly breaking my brain. The specified geometry looks like this:<geometry id="g_1"> <mesh> <source id="src_3" name="position">
hey,I was converting a LAS point cloud to a geotiff and got the following error"Surface Model could not find 3 non NAN seed points"Any ideas whats the problem? Many Thanks,Koen
Hello all,I want to use the ArcGIS api from PythonCallers in FME, and do that on server.https://developers.arcgis.com/python/guide/install-and-set-up/All works fine on desktop, when I switch to the ArcGIS Pro python.When I install the library, and its dependencies in my Documents/FME/Plugins/Python/python36, and use the Default Python 3.6 for my workspace, I get a message Python Exception <ImportError>: dateutil 2.5.0 is the minimum required versionWhen I doimport fmeimport fmeobjectsimport dateutildef processFeature(feature): logger = fmeobjects.FMELogFile() logger.logMessageString("dateutil is version {}".format(dateutil.__version__)) I get dateutil is version 2.4.0Even when I have added the dateutil 2.7.3 package to my plugins/Python/python36 folder. It seems I can't override the dateutil-version and therefore not use the arcgis library.I do not intend to install ArcGIS Pro on our server, as of licencing, overhead, and I want this to run on FME Cloud as well, which is Li
I have a point cloud from Leica (.bin file) how can I read it in FME.Can I convert this to a Las file or E57
Hi,I'd like to restructure a csv by separating what is essentially one column of data with a huge text string which makes up constituent attributes and the corresponding data below it into the attribute values. Something akin to the 'text to column' in Excel.Apologies if I haven't made this very clear, hopefully the csv I've provided will explain further. The top row contains the column headings I wish to split out.Any suggestions would be most appreciated.
How i can auto upload output file from GeoJSON writter to Azure blob storage in FME. And output geojson file must be in folder with name generate from current date. Sample name folder: "18.10.2018-01.15PM".To upload to Azure i propose command-line programm AzCopy . But I no have idea how to do this with AzCopy )))https://docs.microsoft.com/en-us/azure/storage/common/storage-use-azcopyPlease help me to do this task. you help very appreciated.I want upload file in below screen to azure blob storage by schedule. Manually uploaded file in blob storage on Azure
Hi, I have a WFS service with features in EPSG 31468. According to the EPSG registry that's a mixed up CRS with axis 1 = Northing = X and 2 = Easting = Y. The actual features do however come through in XY order, but if I leave the axis order parameter unset the coordinates display in Inspector inverted, if I set it to 1,2 all is well. What is the logic going on? Thanks.
Problem : i use esri feature service to read data from data provider , the problem is domains extracted with code not values . we have large amount of tables i need just a way to resolve these domains and save it in DB . may be one domain used in many tables . is there is any idea about this issue and how to solve.Note . i read the article Working with Geodatabase Domains: Creating A Coded Domain. it is very useful for reading from geodatabase i need same when reading from esri feature service . or just give me a workaround solution FME version 2018.1 32bit
When running in FME Desktop 2016.1 using both 32-bit / 64-bit versions. I'm encountering this error while writing to the ArcGIS Portal Feature Service. The same error is found when deployed to FME Server. After being able to connect to the portal and while the writer is requesting the metadata, it encounters this error. ArcGIS Online Feature Service Writer: Requesting metadata for layer/table 2 of Feature Service at <Portal Service URL>Python Exception <KeyError>: 'hasZ'A fatal error has occurred. Check the logfile above for detailsThis does not happen in FME Desktop 2017.
I am looking to read from an Excel file in SharePoint, do some analysis, and write back (update) that same Excel file in Sharepoint. How would I do so? It appears I can only read from/write to SharePoint lists, not actual files. The FME help is pretty vague. There is a blog post that describes how one company migrated millions of documents to SharePoint so there must be a way to upload the files. However, I can't find any "how to" documentation. Can anyone point me in the right direction? Thanks!Aaron
Hi there!I tried to use ExcelStyler in order to lock cells and change background colors according to the value of an attribute (I have 4 types). For one type all columns must be locked, for an other one only a few, etc. But it doesn't work, my Excel remain without formatting. Also when I try to lock the cells in the User attributes / Manual / Edit formatting of my writer.When I went to Writers / Update Feature Type / select my XLSX / Parameters, I saw 3 tickboxes (Read formulas, Read hyperlinks, Read formatting) that I tried to activate. Here I get a message "No matching feature type(s) found in the selected dataset."Any idea what I should do?Additionnal questions: do you know if there is a way to insert an Excel formula in a field? to put a text string (like "Link") with an hyperlink behind (http://...) ?I hope you can help me!Best regards
Hello, Fairly new to FME. I have a postgis table and I would like to extract records WHERE.... fieldA = the records from an excel sheet column, then take those records and convert them to a shapefile. I can do this manually using ArcGIS or QGIS using a query to query out these records but how can I streamline this process using FME? Thank you.
So i get this error:FME Configuration: Source coordinate system for reader IFC_2[IFC] set to `IFC_COORDSYS_0' as read from input dataCoordinate System `IFC_COORDSYS_0' parameters: CS_NAME=`IFC_COORDSYS_0' DT_NAME=`WGS84' ORG_LAT=`42.41486358638889' ORG_LNG=`-71.25807189916667' PROJ=`AZMED' QUAD=`1' UNIT=`MILLIMETER' X_OFF=`0.0' Y_OFF=`0.0' Storing feature(s) to FME feature store file `C:\FOO\Bar\wb-xlate-1539634722829_3772_221844\inspector.ffs'NormalVectorFinder_Walls_CoordinateExtractor_9(TestFactory): NormalVectorFinder_Walls_CoordinateExtractor_9: <index> parameter (84) to @Coordinate is out of range -- it must be an integer i such that -n <= i < n, where n is the number of vertices in the feature -- in this case 80NormalVectorFinder_Walls_CoordinateExtractor_9: <index> parameter (84) to @Coordinate is out of range -- it must be an integer i such that -n <= i < n, where n is the number of vertices in the feature -- in this case 80A fatal error has occurred.
Hey everyone,I'm writing a validation report to an excel writer and has multiple tabs for different layers. I have gone into the Excel writer parameters and changed "Start Column:" and "Start Row:" to 1 and 1. However, when I inspect the Excel sheet, I've noticed that the validation errors are starting further down the excel page, around row 2000. I do not have any blank attributes. Am I missing a step to have all my rows start at cell 1 instead of starting at a different cell.Thank you for any guidance!David
Hi FME community, We have a use case to make small tiles of big point cloud datasets and upload these small tiles to a Azure Blob storage. When this works locally, we want to publish this workspace to FME Server. The AzureBlobUploader needs an attribute value or file path. One solution would be to use the temporary file paths created from a prior transformer as input file path attribute (such as "...\\AppData\\Local\\Temp\\wb-cache-azure_blob_upload-r10040\\Main_StringConcatenator -1 52 fo 0 OUTPUT 0 4acde95f2a8d56865e616291d87184930d1d8dc9_6.fps"). Is there a way to get these temporary file paths from for example the StringConcatenator transformer automatically in a FME attribute in order to use it directly into the AzureBlobUploader? I looked into the TempPathnameCreator transformer, however this transformer does not write the output of a transformer to the given temporary file path as far as I can see. I am curious to your solution. Kind regards, Jan
I use "LOG_STANDARDOUT Yes" in a batch-command to Display logging of a workbench!Is it possible to also Display the time like it is the log-file?