Using readers and writers to extract and load data.
Recently active
My workbench that reads/writes geotiffs worked great until I upgraded to 2019. I thought it was a writer issue, but it turns out it is an issue with the reader. The input geotiff is an ortho generated by Agisoft Metashape software. Viewing the geotiff in FME 2018 (or Arc or QGIS), it looks correct. Viewing in FME 2019, it looks very different with lots of banding and altered pixel values. I have attached 2 screenshots - 2018_good and 2019_bad to show the difference. This is the exact same file, yet FME 2019 reads it (and writes it) very differently. I have viewed geotiffs from other sources in FME 2019 and they read correctly, so there must be something different about these particular files from metashape.. but why does FME 2018 have no issue with them? Test image -
Hello,I wanna create a shapefile reader wich prompts me everytime for a source file destination beacause i am planning to apply my workspace on multiple files. I made the sourcefile as a user parameter, but when I change the file I get always the following message : Unexpected Input: During translation, some feature were read that did not match a reader feature type in the workspace. This can happen if the reader dataset if changed, or a reader feature type removed or renamed.
I am new to FME desktop, so i understand that this question may be already answered or that i have missed the right transformer due to my unfamiliarity/noobiness.Context: I am in the final stages of converting a combination of arcgis model builder, python and SQL processes that result in 15 "_new" datasets being produced and outputted into an SDE database (a weekly process - In FME i am working with full file replacements and not merged/replaced data.). The final step is to have the 'new' datasets become the 'current' datasets, and what is known as the 'current' data to become the '_old dataset (i.e. back up). Currently the update (renaming) of these datasets into production is done manually (not ideal), so i am aiming to speed up the renaming and reduce the chances of human error. In essence each of the 15 datasets in the database has a total of 3 datasets related;'_old' = previous weeks data kept as back upcurrent data which has no _su
Hey,I'm using a CityGML-Writer but unfortunately I have some Issues with the correct xsi:schemaLocation. I tried different versions, but nothing worked. So for example I used http://schemas.opengis.net/citygml/profiles/base/2.0/CityGML.xsdbut I received an error: 2019-07-02 22:52:43| 3.0| 0.0|INFORM|The uri-map document 'C:\\Program Files\\FME\\xml\\urimap\\gml_citygml.xml' is being used to map from URI to URI2019-07-02 22:52:43| 3.0| 0.0|INFORM|A <schemaLocation> in the uri-map is overriding the namespace 'http://www.w3.org/1999/xlink' xsd location from '../xlink/xlinks.xsd' to 'xlink.xsd'2019-07-02 22:52:43| 3.0| 0.1|FATAL |XML Validation: Fatal Error in 'C:\\Users\\Alex\\Desktop\\IfcTestGeometrie.gml' on line 2, column 1309: 'schemaLocation does not contain namespace-location pairs'2019-07-02 22:52:43| 3.0| 0.0|INFORM|XML Validation: '0' warning(s) found.2019-07-02 22:52:43| 3.0| 0.0|ERROR |XML Validation: '1'
Hi!I am trying to convert a ESRI shapefile to a GMLwhich will be input for a calculation model that only takes GML. While building the conversion I get stuck at 2 issues.When you open the desired result and my current result in an Inspector, you will notice some difference leading to my issues:Independent of how many records I pass from the shape to my current result, I will always have 1061 records in my current result. As this is the number of records my desired result has, I am looking for a way to remove all records (but not the column names) from my desired result and fill it with the records that come from the shape. Any idea how to do this?In my desired result I found a kind of list object I can’t really understand. It looks like a listobject without a record in a column as the value is <missing> but if you click on the record it shows you a listobject. Is this a nested list? How do I build it? I will try to give some more context on this with some help of examples and sc
Hi,I got this error sometimes but not systematically. It could be that if I run this again I would not get the same error for the same file. "PointCloudSplitter (PointCloudSplitterFactory): Failed to get block of 10000 points starting at index 3100000."Is there a way to check beforehand is this transformer is going to fail?Best regards,Felipe Verdú
Hello there I have an excel with multiple columns and I am using attributes exploder in order to get one sheet with the attribute name and attribute value then we will do some cleaning and want after that to go back to the same sheet where each column will have the attribute name and its corresponding value I did follow all the articles over but I am sure something is missing, I am using FME 2019
Hi ALLI have excel data as below and I want to consolidate each designation's fibre records into one row like below:Can anyone suggest how to do it?Thanks a lot.Input data
Hi EveryoneI need help. I want to group a list of cable range into a textline per designation/sheath to feed Labeller for each designation's label.Input data example as below: I would like the output as below Can anyone teach me how to do it? Thanks.
Hi all,I have a need to write electrical network data from an older Oracle Spatial database to a Smallworld 5.x Electric Office, and the geometries belonging to different substations should be written to their own 'internal worlds' in Smallworld. We can assume that there is a field with values that identify what geometries belong to what substation. (each substation has a unique identifier)Does the standaard (GE) Smallworld 5 writer have the capability to expose world_id and universe_id as attributes on the output feature class, so that the value can be assigned during runtime and the features are written directly to the correct internal world?The SBS plugin for Smallworld does offer the capability but it's additional license cost. I believe this was not possible using the Smallworld 4 writer. Has someone worked with the latest Smallworld 5 reader/writer? Is it different from the Smallworld 4 reader/writer?Thanks!Joep
The question basically says it: When writing GML-Geometries via the AIXM 5.1.1 writer, polygons are written as GM_LinearRing instances. How do I write out polygons as GM_Ring{GM_Curve{GM_LineString{gmlPosList}}} instead?
Hello!I would like to have a color in a tab when I write an excel file. I don't find the solution on the excel writer parameters, or excelstyler. I would prefer not use template file.Thanks!
Hello,I have a URL To a Google Sheet that can be read by anyone who has the URL. I can access and view this in Google Chrome, without entering any Google Account Credentials. Is there any way to do the same in FME?When I try to authenticate my own google account in the Google sheet Reader I get an error:400. That's an error.Unverified state_wrapper. That's all we know.Any ideas would be appreciated!Regards,Helen
We have had to stop using Slack and instead use Google Chat for our workspace logging statistics. How do I go about posting to a Google Chat room directly from a workbench?
Hi All,Did anyone use FME Workbench converting TIF with TFW files into JPEG format with GPS data embedded?I am hoping to use Autodesk ReCap to process the raw stereo imagery, but I only have them in TIF format with TFW files.Autodesk ReCap PhotoPlease help, really appreciate!Thanks,Reno
Greetings, I have built LOD2 CityGML from Shapefile and Point cloud XYZ data. Also the point cloud is converted into a 3D Mesh file. Available mesh data format of the mesh are *.obj, *3ds, *collada, *glTf.Is it possible to texturize the extruded buildings using the Mesh? Appreciate your time and suggestion.Mesh: LOD2 CityGML
hello,I used the Generic reader to read shpfiles in workbentch and it runs wellbut when I published it to FMEServer it can't read,why?I checked the fmeserver logs as follows:--------------------------Generic Reader: Unable to guess a valid reader name from dataset 'C:\\Program Files (x86)\\FMEServer\\Server\\Upload\\Samples\\sampleWorkspace2.fmw\\02E4A34DB47D2A91DAB1CA7252C23994\\JSON6.dbf,C:\\Program Files (x86)\\FMEServer\\Server\\Upload\\Samples\\sampleWorkspace2.fmw\\02E4A34DB47D2A91DAB1CA7252C23994\\JSON6.prj,C:\\Program Files (x86)\\FMEServer\\Server\\Upload\\Samples\\sampleWorkspace2.fmw\\02E4A34DB47D2A91DAB1CA7252C23994\\JSON6.sbn,C:\\Program Files (x86)\\FMEServer\\Server\\Upload\\Samples\\sampleWorkspace2.fmw\\02E4A34DB47D2A91DAB1CA7252C23994\\JSON6.sbx,C:\\Program Files (x86)\\FMEServer\\Server\\Upload\\Samples\\sampleWorkspace2.fmw\\02E4A34DB47D2A91DAB1CA7252C23994\\JSON6.shp,C:\\Program Files (x86)\\FMEServer\\Server\\Upload\\Samples\\sampleWorkspace2.fmw\\02E4A34D
Hi,is there any option how to set the readers options, that I do not need to add a new reader when I want to change a dataset? I have always Ersi Format, but a different Dataset, and the same workbench.Till now I added always a new reader with a new name, but now I have to do a lot of things, so I would preffer to change only dataset instead to add a whole reader.Thanks.
I have a workspace where I fetch las-files and clip them with a bounding box. I connected an inspector after the clip-transformer and the Inspector starts up but then crashes. The las-files are indeed created, and I can open them with i.e ArcGis Pro. I have also tried to open several of the original las-files with the Data Inspector but no success. I am using FME( 2019.0.1.0 (20190506 - Build 19253 - WIN64). I have also the 32bit-version installed(2019.0.1.0 (20190506 - Build 19253 - WIN32)) and the data inspector fails in the same way. I have run out of ideas and I hope someone can point me in the right direction. Thanks in advance.
Hi!I have a .docx document framework (template) and I would like to insert specific "field" with QuickPart or anything like that on the document. Then, with FME, write data on this specifics locations.Is it possible? I think not because I read on the Microsoft Word Writer description "The writer can either create a new document or append to the end of an existing template document ".Maybe with programmation?The same question on excel. I would like to write on named cells (like A2 is named "VALUE1" for exemple) in the best case scenario. Or if is not possible, write on the same sheet but on differents locations specified by number row/column. But when I duplicate writer, I can't give the same sheet name. Maybe do a series of FeatureWriter, but I don't succeeded. Thank for your answer.
Hello! I have a large CSV of thousands of properties in Edmonton that are in Lat Long, I want to convert these into UTM and then into UTM zone 12 N and show them in Arc, and advice? never used this software before
I have a workbench that reads an Access database. The workbench works fine on desktop but fails on FME Server.The log records the following error - 'Type=5;Data Source=\\\\server1\\file1\\file2\\example.mdb;User ID=admin;Password=********'. Provider error `(-2147467259) Cannot open a database created with a previous version of your application.'A quick google seems to indicate that this error occurs when you try to open Access 97 with Access 2013 or later. Is this the issue? and is there a workaround? I hope there is as my client is unable to update their version of Access .
I am adding a client's data from a Google Sheet to some shapefiles. I currently read the files online with my gmail sign in info but this is not a workable solution to incorporate into an automated workflow. Because these are not my files, but generated by the client, I'm not sure how to use Refresh Token or OAuth2. I am very new at all of this and none of those things make sense to me. Any suggestions on how to read in these docs?
Hello !I have a workflow that ends with a writer in txt format and an Emailer that should send the same text. An exemple of the txt file from the writer is attached. This are names of administrative areas, grouped by an attribute (set in an AttributeCombiner parameters) so in this exemple there are two "blocks" of text.Is it possible to sort by alphabetical order the text inside each group ? I can't figure it out since the text is already combine with the AttributeCombiner...I also need to send an email with the same text message. I tried the Emailer transformer but it sends an email for each group/block of text, so 2 emails here. I would need just one. Moreover, the text formating is lost in the email received (i.e. each administrative area in a separate line)... I tried to connect the Emailer to a FeatureWriter (in txt format) instead of the AttributeCombiner but I can't find how to Edit Value in the FeatureWriter... and the Emailer doesn't seems to provide carr
HI,I'm converting geodatabase GDB files to PostGIS. The table conversion works well but some of the attributes are empty after the conversion (only 5 attributes over 200 in 7 differents tables).The five attributes don't have the same types.Does anyone knows where it could come from?