Using readers and writers to extract and load data.
Recently active
Unable to get the Web Service to Authenticate (redirect url)BTW, we are no longer allowed to use our personal accounts for Auth, therefore we have Service Account files we use. Therefore, unable to create a Web conn either. Only way I can create a writer is to select Service Account file and define the table myself. Then I preface the writer with a PythonCaller to get the creds.When defining a NUMERIC in the writer, does not allow me to specify width/precision. Any updates to this writer planned soon?
Hi, I have a workspace I am wanting to upgrade from FME 2019.2.3.2 to 2022.2. It creates geopackages that could be read in either QGIS 3.22 (late 2021 release) or ArcGIS Pro 2.6.10. We just tested and they also open in ArcGIS Pro 2.9.5 (Oct 2022 release).Upon upgrading (with or without changing the feature writer to specifically use the new OGC Geopackage writer format) ArcGIS Pro can no longer read the output. QGIS can read it fine.Whilst I presume this is likely an esri compatibility issue, what I am wondering is what the underlying SQLite version is, and what the Geopackage version is - I could not find this in the documentation of the writer (easily - forgive me if I have missed something)?I then have something to check against the esri compatibility as they list out the versions supported. Cheers John
Hi, I have a dataset in .dbf format, with 885 rows. When I read the file in FME it reads the 885 rows, but when I use the DuplicateFilter it tells me I have 330 unique rows and the rest are duplicates. But actually all these 885 rows are unique, I can see that when I look at the file using ArcGIS Pro, and my colleague have looked at the file in another text-application. So it seems FME keeps the total number correct, 885, but changes some unique numbers so they are duplicates somehow. In AGP:In FME: How can this happen? I have tried reading the file both using the "normal" .dbf-writer, as well zipping the file and using Creator > ParameterFetcher > FeatureReader > FeatureReader > AttributeExposer.
Hi all, I have an WFS from a vendor that contains several polygons and associated attribute information. When I attempt to read via the OGC WFS reader, I encounter an error: <WFS> An error occurred while reading a GetFeature response, to ignore the error and avoid losing the previously read features, set the WFS "Ignore GetFeature Error" parameter. Total features downloaded: '0'As instructed, I've attempted to modify this setting, but continue to receive this error even when I've set to ignore. I've tried several iteration of different settings in the reader to attempt to resolve to no avail. I have noticed that if I enable the option to Disable XML Namespace Processing that I no longer receive the error, but I still do not get any returns -- perhaps there is some other setting I should investigate? I'm certain that this is specific to the reader as I am able to view returns from this WFS URL via httpCaller, Postman, and as a ArcGIS Online serv
Hi all, Not sure if someone could help me with this doubt.I'm trying to convert from SHP to MAPINFO a polygonal layer. I fill the Advance property from the Writer to be used the File Version = '300'. Once finished the conversion I see the file has taken '800'. Other layers maintain '300'. Not sure why some layers stick to the fixed '300' value that I give and others no.I'm using 2022.1 FME Desktop version. Thanks,J.
Hi, Is there a transformer within FME that could format CSV into plain text with formatting, see the attachment? The original file can also be in another format, for example excel. If someone can think of another writer that will facilitate the solution of the problem, it can be. file original - source datafile required - required data Thank you
I'm looking for a workaround to a small bug in FME that currently exists (Safe already know about the issue).I need to write some values into a spreadsheet, from which a formula calculates a result. I then need to read back the result in another process. However, it seems that the result is only available to FME if you open the Excel sheet manually and save the spreadsheet and then close it again. If you try to write the values and then read the result straight back without opening the spreadsheet you don't get back the calculated value. This is therefore no good as it makes an automated process difficult.You can see the issue demonstrated here.Does anyone have any magic workarounds to force a commit or a save in the spreadsheet behind the scenes, without the user having to intervene?
Hi. Can FME workbench read a .gws file? I only found this linkhttps://community.safe.com/s/article/fme-and-intergraph-geomedia-compatibilityThanks
We use file geodatabase replicas to edit our enterprise SDE geodatabase. Edits made to these file geodatabases by FME are not recognized as "changes" when these replicas are synchronized to the master.Has anyone found a way to solve this?I see a post from Mark Stoakes (about 5 years ago) where he explains that FME cannot make entries in the change tables maintained in the replica - which definitely makes sense.Just wondering if anyone has possibly solved this?
Its possible to write the TAGs but in MicroStation the tags do not work.I use FME 2016Thx for help.
Customer has a working migration chain on FME 2021.2.5 and we would like to upgrade to 2022.2. At first, I started extracting data using FeatureReader from our source (Oracle Spatial), but I have strange warning message in the log and not all data all extracted from the source. Warning message in the log relates to entries in ALL_SDO_GEOM_METADATA which are all set correctly – I would mention once more that data reading from Oracle using same workbench in 2021.2.5. is working. Here is the warning message: Execution of statement `SELECT table_name, column_name, (SELECT COUNT(*) from TABLE(META.diminfo)) dcount, SRID FROM ALL_SDO_GEOM_METADATA META WHERE ALL_SDO_GEOM_METADATA.owner = '<SOURCE_SCHEMA>''did not succeed; error was `ORA-00904: "ALL_SDO_GEOM_METADATA"."<OWNER>": invalid identifier'. (serverType=`ORACLE8i', serverName=`SERVER_NAME', userName=`<FME_READER>', password=`***', dbname=`') If I try to execute
IfcPresentationLayerAssignment is the entity where autocad layer information is stored in my ifc model. I can see that it is included in the ifc-file by reading it as plain text. However I can't seem to expose that entity in FME. I have tried different combinations of AttributeExposer, GeometryPropertyExtractor and listexploder. Is there anyway to expose that attribute and its values in FME?
Hi all, I'm manually fixing broken photogrammetric models of buildings (common errors like holes in overlit white walls etc.) and then I want to convert these fixed OBJ models to SLPK. I use this workflow: OBJ Reader – merge mesh parts: yes, move to coordinate system: yes, coordinate system: EPSG:5514 (Czech/JTSK.Krovak),Offsetter (to move it to correct geolocation) – X Offset: -747078.00223783311, Y Offset: -1054893.7301940639, Z Offset: 289.74612628016621,Esri Indexed 3D Scene Layer Writer – coordinate system: EPSG:5514 (Czech/JTSK.Krovak), geometry: i3s_terrain_mesh....but no file is created. I guess the problem is probably that the models are really big (over 0.5 GB)? Thanks for your help,Michal
I have a template dwg with a property set attached to lines and polylines. When I write a dwg and use that template is it then possible to fille the property set from FME?
I am trying to convert speciality maps for use in avionics software. I have converted the mbtiles to CADRG, and they import and display in the computer software, falconview properly. However I import them into the aircraft they display all black. The only thing I can tell is the CADRG has been exported with. 217 color tables bet pallet, with the last table being 0,0,0 which I think is causing the display to be all black. many ideas with resolving this issue? Thanks.
I'm encountering an issue reading NetCDF files I got from here:https://dap.ceda.ac.uk/badc/cmip6/data/CMIP6/CMIP/AS-RCEC/TaiESM1/historical/r1i1p1f1/day/pr/gn/latest/ When attempting to use a ListSearcher to search the "netcdf_coordinate_variable" list for an element with axis = T, I get no matches, even though its the first element.I also get no results using a ListExploder and a Tester to test the axis attribute.In fact the only attribute from the list that will match is "name". Looking at the list there are 2 elements, and the second element only has a "name" attribute and no others.I could see why this might trip up the ListSearcher, but I don't understand why the ListExploder + Tester method also fails to match? This is with FME 2022.1.2 on MacOS. I've attached a workspace (data linked above) and a screen shot showing the list has an element with an axis value of "T".
Hi,I want to find local low point in the point cloud. It is to bring out possible locations for water accumulation. Does anyone know a solution to this problem?
Hi FME team I started on using FMEObjectsDotNet4.dll and started reading CHM helpand I started to write some simple code, and I'm stuck on mapping FMEReader GEOMETRY column to another GEOMETRY column in FMEWriter FMEReader is from shapefile but the target database oracle table has 2 columns and I want to directly update to 2nd column, and seems cannot find the right "keyword" in CHM help, also the samples is not really helping with this problem C:\\Program Files\\FME\\fmeobjects\\dotnet\\apidoc\\FMEObjectsDotNet4.chmC:\\Program Files\\FME\\FMEObjectsDotNet4.dll Also in IFMEOWriter seems lacking IsOpen method to check whether the connection still open or notso we can do something about it. Maybe like manually commit .. on another topic:1) is there a NUGET feed from you for this library like Telerik nuget feed https://docs.telerik.com/devtools/maui/get-started/install-nuget https://nuget.telerik.com/v3/index.json2) is there a link/resource/forum/video/training/repository
I need to revisit this answer, that I find to be a limited work-around, not a proper solution.The offending and unsupported type "mediumint" is not from the MS/SQL database, where data are sourced, so it has to be something that FME itself generates on the fly. Aka a bug.The database table has a field named ID, which is an "int" (32 bit), and it uses an identity value.This is how the schema feature sees the field:I really cannot understand, why FME cannot transfer this to a table in a Geopackage. The very same schema and data feature are used to create a GeoJSON with any problems.Please advise.Using 2022.1
Greetings,I am finding the settings...AutoCAD Reader > Parameters Tab> General Section > Layer Name field, Allowed Geometries field.....greyed out. How can I access and change these settings? Thank you,Tyler FME 2022.1
Can'i catch the contraints oracle with the FeatureWriter? I need to test the integrity of oracle and catch the exception and do something if an error occure.Execution of statement `UPDATE "MYTABLE" SET "STATUT_PRP_R" = :"STATUT_PRP_R" WHERE "OBJECTID" = :"OBJECTID"' did not succeed; error was `ORA-02290: violation de contraintes (PRP_AQU_BORNEINCENDIE_P_CHK) de vérification'. (serverType=`...
Hi,I posted this earlier on the Package page, but I'll paste it here to be sure to get an answer. So, I get this error while trying to authenticate with my Google account: Authorization Error Error 401: disabled_client Sign in with Google temporarily disabled for this app. This app has not been verified yet by Google in order to use Google Sign In. Learn more Request Details The content in this section has been provided by the app developer. This content has not been reviewed or verified by Google. If you’re the app developer, make sure that these request details comply with Google policies. access_type: offline approval_prompt: force response_type: code redirect_uri: urn:ietf:wg:oauth:2.0:oob client_id: ERASED.apps.googleusercontent.com scope: https://www.googleapis.com/auth/bigquery Is the package valid or is it something I should check on my side ?Thanks Philippe
I have comprehensive worskpace to write many tables in PostGIS, where all the target attributes are in lower case. Now I need to migrate this workspace to work also on MS SQL. I was able to change the writer and bulk update feature types table qualifier. The schemas are just similar to Postgres DB, but I'm getting errors because of the lower case of the attributes while writing to MS SQL.Importing new feature types from schemas is not a way because I need to maintain the attribute mappings on every feature type. For example, the table name in lower case is not an issue but column names are. I would need that the writer forces UPPER CASE on writing to DB or bulk change all the attribute names in all writer feature type to UPPER CASE. I´m not feeling to do all the mappings again from the scratch, if the schemas are the same.On the attached picture you can see the attributes from changed writer feature type (PostgreSQL->MSSQL, left) and new imported feature type (right). There is j
Hi, I wounder how I could manage to install the Rhino module for python (external package)? I have tried to look up info from:https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_Desktop/Workbench/Installing-Python-Packages.htmand:https://community.safe.com/s/question/0D54Q000080haVOSAY/how-to-install-external-python-packages. What I seem to manage to do is to install the module with the following command:fme.exe python -m pip install rhino --target C:\\Users\\*\\*\\Documents\\FME\\Plugins\\Python\\python37 The module seem to be installed at the directory, but when I try to import it (import Rhino) using python caller I get the error msg:|Python Exception <ModuleNotFoundError>: No module named 'Rhino'.The Rhino module is a non-universal package and I have tried to verify python interpreter to both 3.7+ and 3.9+ when running pyhton caller. I am using FME v2022.1.2.0 64-bit. When I used to command line it prints; "INFORM: Using python interpreter **\\python39.d
Hi, I am currently writing my master's thesis on the subject of "Geodata according to BIM". In particular, the georeferencing of the IFC file using FME causes problems. In concrete terms, the necessary IFC entities "IfcProjectedCRS" and "IfcMapConversion" cannot be written. How are these defined and written with FME? IFC Version 4 is to be written. (FME 2019.1.2.0 (Build 19630) and WIN64 are used for the data conversion.) Do you already have experience with georeferencing IFC4 files using FME?