Using readers and writers to extract and load data.
Recently active
See https://knowledge.safe.com/questions/38060/sde-connection-files-and-fme-server.htmlI might be OK with read only ArcSDE connection files being in a shared area, but ones with write access need to be restricted. So new system share may be the answer.If I have a Workspace with a read only ArcSDE connection and a write ArcSDE connection, I can't seem to choose separate locations on server for each one - they both have to go in the same place (that's using FME 2018). So it looks like I will have to create a Workspace with the read only connection file and publish that to upload it to the shared area, then use that in Workspace with the write connection file stored locally.Is there no way to load ArcSDE connection files into the shared area outside of Workspace publishing? Can you just copy the files to the appropriate folder on the FME Server server?
Hello, I want to get the value from <a> tag in the following HTML table, someone has an idea how can I get it? I tested HTML extractor, FeatureReader, but don't return me "Website". Thks<table id="myTable"> <tr> <td>hello</td> <td>it's me!</td> </tr> <tr> <td>it's just a table <a class ="myClass" href="https://example.com">Website</a></td> <td>with two columns</td> </tr></table>
I've got some data in json which have some different geometries in it I want to read these with FME and output geometries, polys, lines, etc I attached the files, do I need to somehow change the way the coordinates are formatted' to be able to create the geometries? How do I best go about this in fme? also have pretty much the same data in xml, attached that too.my plan was to extract the coordinates with attributesplitter but that got troublesome for anything other than a point feature
When I publish a workspace that uses an SDE Connection file where do you recommend storing them? Our IT changes database user passwords regularly and this makes it difficult to keep the SDE connection files published to FME Server up to date.
Hi all, I'm having a problem writing to Azure Cosmos DB where I format the attributes as in the image below and use the Azure Cosmos DB writer to write to the DB. When I test connection and write it says all good however when I go to view the data I get this error and the data hasn't been written. ActivityId: e39bb0d8-2a86-45db-bb62-d50efecc43b7, Microsoft.Azure.Documents.Common/2.9.2' A fatal error has occurred. Check the logfile above for details Failed to specify the feature index as constraints on the reader Cosmos DB (DocumentDB) Reader: Request failed with HTTP status 400. The message from the server is: 'Cross partition query is required but disabled. Please set x-ms-documentdb-query-enablecrosspartition to true, specify x-ms-documentdb-partitionkey, or revise your query to avoid this exception. Any help would be very much appreciated! Thanks Joe
HiCould you tell me the procedure to split csv from a line including a specified text.
I have an strange problem with an Enterprise Geodatabase writer.We just migrated from FME Server 2018 32bit to FME Server 2019.2 64bit.Which also means an upgrade to ArcGIS Pro 2.4.I have the following error with writes to an Geodatabase.An error occurred while attempting to store a row into the table 'GEOEDIT.TennetBekendmakingen_vlak_totaal'. The error number from ArcObjects is: '-2147418113'. The error message from ArcObjects is: {} Watch the ArcObjects error. No clue 'that helps'. I had this error at the end of an processing of WFS data to Geodatabase.To troubleshoot this problem (WFS read has a lot of data so is slow) I wrote te data to insert in the geodatabase to een FFS file.I made an new workspace that reads the FFS en writes to de Geodatabase.In my first attempt the write succeeded.So I decided to implement this on FME Server. Orignal workspace writes to FFS. And the second one from FFS to GeoDb.And then the funny bit starts.I've made an automation
When converting Autodesk Civil 3D data (specifically pipes and structure for creating water, storm and sanitary features in shape or geodatabase) with FME, I am not getting any invert elevations. The newly converted features have some AutoCAD attributes in HEX (assumed) format, but non of them make sense as invert elevation when converted to decimal. The export LandXML file from the same Civil 3D does have those invert elevation that could be read as part of structure description, so it is there, just can't get it out into GIS. I really wanted to avoid the process of manual entry of those invert elevations every time I need to add new developments to the infrastructure features. Any help on that?
A selection of features from an Oracle database by means of an Esri Geodatabase (ArcSDE Geodb) reader gets exported to a file geodatabase. The original database table has an ObjectID field which is unique. However, the reader considers this field as of type Integer. In de exported file geodatabase this field is still of type Integer. A python script compares the original table and the table in the file geodatabase on the basis of a common field of type ObjectID, which obviously fails.Is there a way within FME to change the field type from type Integer into type ObjectID or should I take an alternative route?
Can FME Cloud be configured to access my local network drives? For example, could I read something from ArcGIS Online and write it to a shapefile or FGDB on one of my on premise servers?
Im trying to import a BAG file in a database. A bag file has 2 bands (elevation and uncertainty) and a metadata string. I want to import the 2 bands and the metadata features to their own column in a table. When I try to import the metadata string it imports the whole string to one column called: Bag_metadata_string. I have no experience with the xml transformators. I tried to export the string to a xml file and continue with that xml file to import in a database. It worked almost but not completely. When I export to XML it changes the < > to something like &gm; and &gl;When i changed them back in notepad to < > it could be used to import to a database. Unfortunately it created only the columns and didn't import the data.What is a good workaround to work with a BAG file so I can export the metadata correctly from BAG to postgis?
I have shp files with dbf exceedig 5GB each. While using fme to open it and proces I'm getting an error. I'm using FME 64 2018.1 on windows 64b. I can use Qgis to convert but I would like to know how to handle with such files? Link to the file: https://opendata.geoportal.gov.pl/prg/adresy/PunktyAdresowe/POLSKA.zip
I am creating a KML file with FME. Among other things, it creates popups in Google Earth. All is fine; except when I have multipart polygons, the popup window is displayed between polygons and not on one of the parts. Some users may prefer it that way. I am wondering whether that can be control with a setting in FME? That is that the KML popup windown is originating from one of the polygons.
Hi folks, New to the forum and FME, I'm hoping I can leach some knowledge. I have a csv file that imports into FME like this: I would like to manipulate it into the following format: Depending on which file is imported Costs 1, 2 & 3 may be there, or it may be a combination of 1 or 2 costs. All costs do share a common three characters at the left of their name. Is it possible to dynamically look at the cost columns and then transform the data into the format shown in the second pciture? Thanks in advance. Andrew
I am trying to convert JSON file to kml. I am inputting data from source file to Attribute creator and picked Latitude and longitude. This was connected Vortex creator then to Coordinate system setter. This was connected to Writer feature type. I ran the sequence, it generated an error that reads "The workspace may run slower because features are being recorded on all output ports. The below feature caused the translation to be terminated VertexCreator_ (TeeFactory): VertexCreator_: Termination Message: 'VertexCreator output a feature. To continue translation when features are rejected, change 'Workspace Parameters' > Translation > 'Rejected Feature Handling' to 'Continue Translation'' VertexCreator_: Termination Message: 'VertexCreator output a feature. To continue translation when features are rejected, change 'Workspace Parameters' > Translation > 'Rejected Feature Handling' to 'Continue Translation'&#
Hello,I am performing a simple translation that reads in a building DWG file, updates a single attribute (room number), and overwrites the same DWG it read in with the updated attribute. The issue i am having has nothing to do with the translation i am performing but the labels in the resulting DWG. Some of the labels are written out with a text size that is much larger than the original DWG. I have inspected the original drawings text size for these labels, and they are 0.38 but the resulting label text size jumps to 3.06. This only happens on labels that are surrounded by polygon inserts. The labels without these inserts come through just fine. See the attached image where the label for "CORR1" is just fine but "CORR4" is too large but has a polygon insert around it. I have also noticed that the resulting entity handle for this label changes after being written out. Also, when i redirect the writer to fme data inspector, everything appears just as it should.
Good day, I am just looking if someone can point me in the right direction. GoalIfc/Cad File to .svg The goal is to create .svg for PowerBi. By taking a view from a 3d File and saving the view to turn into a .svg file. Below a few screenshots how I have done it before. A .svg is imported into powerbi. When clicking the .svg graphic in PowerBi, the PowerBi table changes to filter only that Column In this example the .svg has the following ID: <polygon id="M1" description="M1" If this ID is found in the PowerBi Data, the column for "M1" is called. ( I have added an example of such an .svg file that I work with: SvgPowerBiExample.txt(saved as .txt file) FME QuestionIs it possible to save a "view" of an .ifc file or Cad file such as .dwg in 3d? Then Vectorize that View and save the internal surfaces as the polygon id needed for an .svg file. For Example, a view in FME that I would like to save as .svg file: My current WorkflowThe workflow is
Using a published parameter such as $(outputTableName) in a SQL writer to name a field.Taking the parameter value to name the identity field as in $(outputTableName)UKID resolves and creates the column no problem when using a standard SQL writer. So, setting the parameter value to "MyOutputTable" results in a field name of "MyOutputTableUKID".When attempting to do the same in a SQL FEATURE writer, the parameter will not resolve, and the column is created with the explicit string value '$(outputTableName)UKID'.Is this behaviour expected between the two varieties of writer?
Hello, I have las file in which some points after some manipulation produce separate cluster of points as shown on the image.How could I produce separate boundaries for each cluster?
Hello, I need to write the resulting file to the same directory where my source file is, no matter where is the workspace. However, variables cannot be inserted into the writer's destination directory. Can anyone help?
We have a DWG that has a number of scale bars shown in paperspace. In the DWG the units are visibleBut when it is brought into FME the units are missing. My guess is that the units are dynamically generated in the DWG based on the viewport scale and as such are not really annotation but some attribute / tag associated with the line.Is there a way for FME to find the values so they can then be used to output to PDF. Update 1:Here is a a sample DWG with the issue included. Update 2:What I have discovered is the scale bar is a 'block' and the text is a tag associated with the block. Is there a way to convert the 'tag' to text in FME?
I have 2 dynamic writers in which data are coming from 2 readers (SQL Spatial and SQL non-spatial, respectively). Actually the readers are reading from the same database (A, for example) and the writers are writing out to the same database (B, for example). The reason why I have 2 readers is because there are spatial data and non-spatial tables in database A. I have a SQL script that can set ObjectID to Primary Key. It doesn't seem working properly when I put SQL script into the first writer (spatial). Therefore I had to put this SQL script into the second writer (non-spatial) to make it run properly. Any ideas? Thanks
I have a CSV file where I need to read only the first line (or first column/line combo) of the file. Is there an easy way to do this with a reader? Or am I stuck reading the whole file? I've tried both the CSV reader and Text File reader. In both, I don't see anyway of isolating this first line of text/data. I'm forced to bring the entire table into the workspace. Thanks in advance!-Mark
I am trying to harmonise an average windspeed ShapeFile to INSPIRE GML.In the in EnergyResourcesCoverage application schema there is a RenewableAndWastePotentialCoverage feature type. However, I can't seem to add it as a writer. I only see the option of the RenewableAndWasteResource feature type. Does anybody else have experience with this? Or is there another way to create this INSPIRE GML?
How to create an index for a mongodb collection using a json templater ?Thank you