Using readers and writers to extract and load data.
Recently active
Hi, I have a WFS service with features in EPSG 31468. According to the EPSG registry that's a mixed up CRS with axis 1 = Northing = X and 2 = Easting = Y. The actual features do however come through in XY order, but if I leave the axis order parameter unset the coordinates display in Inspector inverted, if I set it to 1,2 all is well. What is the logic going on? Thanks.
Problem : i use esri feature service to read data from data provider , the problem is domains extracted with code not values . we have large amount of tables i need just a way to resolve these domains and save it in DB . may be one domain used in many tables . is there is any idea about this issue and how to solve.Note . i read the article Working with Geodatabase Domains: Creating A Coded Domain. it is very useful for reading from geodatabase i need same when reading from esri feature service . or just give me a workaround solution FME version 2018.1 32bit
When running in FME Desktop 2016.1 using both 32-bit / 64-bit versions. I'm encountering this error while writing to the ArcGIS Portal Feature Service. The same error is found when deployed to FME Server. After being able to connect to the portal and while the writer is requesting the metadata, it encounters this error. ArcGIS Online Feature Service Writer: Requesting metadata for layer/table 2 of Feature Service at <Portal Service URL>Python Exception <KeyError>: 'hasZ'A fatal error has occurred. Check the logfile above for detailsThis does not happen in FME Desktop 2017.
I am looking to read from an Excel file in SharePoint, do some analysis, and write back (update) that same Excel file in Sharepoint. How would I do so? It appears I can only read from/write to SharePoint lists, not actual files. The FME help is pretty vague. There is a blog post that describes how one company migrated millions of documents to SharePoint so there must be a way to upload the files. However, I can't find any "how to" documentation. Can anyone point me in the right direction? Thanks!Aaron
Hi there!I tried to use ExcelStyler in order to lock cells and change background colors according to the value of an attribute (I have 4 types). For one type all columns must be locked, for an other one only a few, etc. But it doesn't work, my Excel remain without formatting. Also when I try to lock the cells in the User attributes / Manual / Edit formatting of my writer.When I went to Writers / Update Feature Type / select my XLSX / Parameters, I saw 3 tickboxes (Read formulas, Read hyperlinks, Read formatting) that I tried to activate. Here I get a message "No matching feature type(s) found in the selected dataset."Any idea what I should do?Additionnal questions: do you know if there is a way to insert an Excel formula in a field? to put a text string (like "Link") with an hyperlink behind (http://...) ?I hope you can help me!Best regards
Hello, Fairly new to FME. I have a postgis table and I would like to extract records WHERE.... fieldA = the records from an excel sheet column, then take those records and convert them to a shapefile. I can do this manually using ArcGIS or QGIS using a query to query out these records but how can I streamline this process using FME? Thank you.
So i get this error:FME Configuration: Source coordinate system for reader IFC_2[IFC] set to `IFC_COORDSYS_0' as read from input dataCoordinate System `IFC_COORDSYS_0' parameters: CS_NAME=`IFC_COORDSYS_0' DT_NAME=`WGS84' ORG_LAT=`42.41486358638889' ORG_LNG=`-71.25807189916667' PROJ=`AZMED' QUAD=`1' UNIT=`MILLIMETER' X_OFF=`0.0' Y_OFF=`0.0' Storing feature(s) to FME feature store file `C:\FOO\Bar\wb-xlate-1539634722829_3772_221844\inspector.ffs'NormalVectorFinder_Walls_CoordinateExtractor_9(TestFactory): NormalVectorFinder_Walls_CoordinateExtractor_9: <index> parameter (84) to @Coordinate is out of range -- it must be an integer i such that -n <= i < n, where n is the number of vertices in the feature -- in this case 80NormalVectorFinder_Walls_CoordinateExtractor_9: <index> parameter (84) to @Coordinate is out of range -- it must be an integer i such that -n <= i < n, where n is the number of vertices in the feature -- in this case 80A fatal error has occurred.
Hey everyone,I'm writing a validation report to an excel writer and has multiple tabs for different layers. I have gone into the Excel writer parameters and changed "Start Column:" and "Start Row:" to 1 and 1. However, when I inspect the Excel sheet, I've noticed that the validation errors are starting further down the excel page, around row 2000. I do not have any blank attributes. Am I missing a step to have all my rows start at cell 1 instead of starting at a different cell.Thank you for any guidance!David
Hi FME community, We have a use case to make small tiles of big point cloud datasets and upload these small tiles to a Azure Blob storage. When this works locally, we want to publish this workspace to FME Server. The AzureBlobUploader needs an attribute value or file path. One solution would be to use the temporary file paths created from a prior transformer as input file path attribute (such as "...\\AppData\\Local\\Temp\\wb-cache-azure_blob_upload-r10040\\Main_StringConcatenator -1 52 fo 0 OUTPUT 0 4acde95f2a8d56865e616291d87184930d1d8dc9_6.fps"). Is there a way to get these temporary file paths from for example the StringConcatenator transformer automatically in a FME attribute in order to use it directly into the AzureBlobUploader? I looked into the TempPathnameCreator transformer, however this transformer does not write the output of a transformer to the given temporary file path as far as I can see. I am curious to your solution. Kind regards, Jan
I use "LOG_STANDARDOUT Yes" in a batch-command to Display logging of a workbench!Is it possible to also Display the time like it is the log-file?
I am looking for a help, How to import arcpy module in FME Server. How we need to call arcpy module using python in FME Server, also what are the files folders need to upload in FME Server to run arcpy code. Please can guide step by step instructions. Thanks in AdvanceVenu
Hi,I'm looking to produce a map which visualizes polygons based on an attribute value (e.g, population) and scales them high to low or low to high. Using FeatureColorSetter i can apply a random colour to each area based on an attribute, but i would like to apply a colour scale. For example, going from a dark red (highest population) to light green (lowest population). Is this something that can be done, without having to use a styling transformer for each different attribute?Thanks
Hi,I´m record data from DWG files, but there is some versions of the same file...for example: V1, V2, V3...What the best way for extract the more recent version by file? I need to create one field called last_date? How I can to extract the last date for example?Thank´s
Hi, I am new user in FME. I have build a workspace that informs as in the drawing below, if the farm is illegible or eligible, based on some socio-environmental criteria of my country. In this table must be updated daily, what only changes in it is if the farm is eligible or ineligible in the status field. Here I need to make a simple update. Look belowThe problem is that this is not the only table I need to update, I need to also update another table, which describes in more detail the reason for the Inegibility or eligibility. However I have to be very careful with the code so I do not qualify the wrong farm. The table that I show below, is the second table and notice that the field analyze_code is equal to the code of the first table. How can I do to update the first table according to the code that already exists and then use the code of the first one to update the criteria of the second table using the FME?Can you help me? Was I clear on my question? I need to make this wor
1- workspace 2- the feature class schema 3- transforming the attributes with test filter and attribute manager 4- the result is the same schema .. without any change 5- the result from the transformer (inspector)
I am trying to translate data from SHP to Smallworld EO. I am getting follwoing error. Please let me know if any one face this issue and how to resolve .:eo_structure_manager expects a preference value for 'eo_auto_attach' on an application service provider 'eo_options' from current_application 'unset'.Regards,Babu
Hi-I'd like to read the contents of a working Excel file in a 2013 Sharepoint document library - to transform and put elsewhere. I have success doing this using (licensed) FME Desktop/workbench 2016, but cannot automate the task with (demo) FME Server [or as a scheduled desktop task]. Is there an SSH limitation with FME between the command-line executable versus the workbench? Is there a proper way to map my Sharepoint library?Thanks in advance.~jake
I am looking into the possibilities to proces IFC_XML messages within FME. I found that the current IFC and Revit readers are not able to read IFC_XML files.One approach is to build a custom reader / transformer / workspace to interpret IFC_XML messages. I think it would be a lot of work to make a custom implementation of the IFC_XML standard in FME. Especially difficult to interpret the geometry of the objects.Another approach would be to use a third party tool (e.g. python library). But i am struggling to find something appropiate. I have only found xBIM Toolkit so far (which is .NET based). I am playing with the idea to see if I can use this tookit to create custom IFC_XML transformer in FME.I would like to hear from others who are experienced with using this format. How would or have you tackle(d) this?
Hi!I am at the moment struggling with reading Civil3D Files(created in Civil 3D 2017/older). I end up with a lot of strange looking Chambers/Structures & most of the Pipes end up as lines. Please see Pictures & attached Example File . The Designer in this case i using a Plugin called "Naviate", which is mostly used in Sweden(I think). These Pipe Networks are also modeled with a huge radius(Which is a bit uncommon I believe). Therefore I thought this could be the source of the problem, and tried creating test networks in a "plain" Civil 3D, to check if it´s due to the Designer/plugins/etc. However I end up with the same result. -------Any known bugs? -Possible to get a test Workspace + test File? -Any guidance on the Topic would be vary helpful.------I attended an inspiring presentation by Dale, showing a neat workflow to handle the Civil 3D Files & the object. Note sure if this was in the 2019.1 version, but as I understood, this should also be possible
I have an issue with a DatabaseUpdater command.It seems to initiate a SELECT * FROM MyTable before it does the update SQL command which is fine for one of my tables as I don't have masses of data so it completes quickly then carries on and does the updates. One of my tables however has millions of rows so doing a SELECT * on this is clearly never going to work and basically locks the table out and becomes unusable.Here is my flow so a csv input passes through a tester then calls to the DatabaseUpdaterSQL Trace:Does anyone know why it needs to do the SELECT * and how I stop it from doing it so my updates run?
Hi,I'm simply trying to convert a DWG to ESRI shapefile but the DWG has no spatial reference. I'm aware of the ability to add DWGs in ArcMap, however, the scale on the DWG file is exaggerated. Below is my FME tool that I setup per FME tutorial and still get the same results. The layer is spatially wrong size and location. When I run the inspector the CRS and units are unknown. What am I missing? Thanks!
I need to write features, coming from a WFS, into PostGIS (I'm using FME 2017.1 Build 17532).Requirements: 1. As the WFS delivers lots of feature types I want to do it dynamically (Dynamic Schema Definition) 2. I need to change table names to lowercase (not only attribute names) 3. I want to dynamically delete all attributes containing "gml_" or "xsi_nil" in their names. No. 2: I copy the format attribute fme_feature_type to a new attribute that I call lowercase_feature_type and change its case. The original fme_feature_type goes into "Schema Definition Name" (so that the writer finds the original schema from the reader), lowercase_feature_type goes into "Table Name". Problem: Apparently there's still a bug in the PostGIS writer so that in the dynamic case the "Table Qualifier" parameter is not respected at all. I solved this by concatenating the desired schema name to lowercase_feature_type separated by a point before assigning
Hi I have used JsonFragmenter to read a json file and have ended up with a set of attribute values plus a list of values for each feature. I need to write the list to single attributes in a table based on the index. (see attached)e.g Signalstatus[0] written to field STATUS_0Signalstatus[1] -> STATUS_1 e.tc.Any suggestion ?
Morning all, I am loading a set of shapefiles into a PostGIS database using a shapefile reader and a PostGIS writer. If I accept the default workbench created by FME the data gets written to the public schema. Where/how can I set the schema in the writer that I actually want the data written to? Probably a simple solution... FME Desktop 2012 sp3 and PostgreSQL 9.1 with PostGIS 2.0 Thanks