Data

UPDATE: The error was not any hidden files in FMECloud - but rather that the process using AzureFileStorageConnector downloaded a whole FOLDER instead of individual files. So instead of downloading a file of size 0,5 GB - it downloaded all the files in that folder (50GB). Havent figured out why yet, but might be something between the screen and the person sitting in front of the computer.  I have a FMECloud instance with 100GB Primary disk, and it seems according to the Dashboard that 97GB is in use. I can only find roughly 60GB in the DATA-folder. And FME Cloud seems to run the cleanup. So i wonder where the missing 40GB of data is. The projects uses a lot of raster-data, so I wonder if they are cached somewhere, or if the FFS is somewhere. But cant seem to figure out what to empty.Moving to a larger instance might be a solution, but Backup 100 GB, download, start new instance 200 GB and restore takes some time....Would be GREAT to be able to RESIZE the PRIMARY and Secondary disk of F

When attempting to use an existing table in a PostGIS database, the PostGIS writer is coercing my 3D geometry objects into 2D. I have not seen this issue with a PostGIS writer that uses automatic table creation and the data type for the geom column is defined as GEOMETRY in both cases.I have seen 2 different warnings regarding this:POSTGIS Writer: PostGIS existing table has a 2D constraint, changing input data into 2D datacoerced to 2D in table 'cad.cad_geom'Why are the objects being coerced?Are there writer settings to prevent this from happening?Here is the table definition:CREATE TABLE IF NOT EXISTS cad.cad_geom( id                      BIGSERIAL    PRIMARY KEY, created                 TIMESTAMPTZ  DEFAULT CURRENT_TIMESTAMP, updated                 TIMESTAMPTZ  DEFAULT CURRENT_TIMESTAMP, xchg_ts                 TIMESTAMPTZ  DEFAULT NULL, _refid                  BIGINT       DEFAULT NULL, autocad_block_name      TEXT , autocad_block_number    INTEGER, autocad_entity_handle   TEXT, au

Hi all,I'm trying to create a workflow for creating LoD2 CityGML from a shapefile of building footprints (and forcing a height attribute) and I am struggling with few issues. I would like to have the buildings composed of wall, roof and floor surfaces but I haven't been able to work out how to compose the surfaces within a single building while also generating the relevant semantic feature types for these surfaces. I'm aiming for something similar to what I want is the LoD2 sample in CityGML 2.0 examples: http://schemas.opengis.net/citygml/examples/2.0/building/Building_LOD2-EPSG25832.gmlSo far, I am simply offsetting a the shapefile to create floor and roof geometries. I also generate a UUID for an gml_id (for the Building) which I thought I could reference from the roof and floor surfaces LoD2 features in order to nest them. However, upon running the workspace, it appears only the Building feature is written out and the RoofSurface and FloorSurface features are ignored.Ca

Hi guys, I do have an issue working with KML on FME. 1) I have a shp file with loads of features and I would like to transform each one of them in one specific kml file. The pic below show us the features I have:I do want to transform them into individual kml files , with an specific name ( i have this information on the file). And I also need that the kml looks like this: I couldn´t manage to make them hollow like this. Can anyone help me? 

I did everything right to set up the Teradata format in FME. I followed closely the documentation here: https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/teradata_jdbc_spatial/teradata_jdbc_spatial.htm. However, when I start FME, I'm still not able to use the Teradata format. What gives?   

Having a couple of problems writing to a versioned ArcSDE Geodatabase:  1. When trying to import an existing feature type from the Esri Geodatabase (ArcSDE Geodatabase) writer I can connect to the geodatabase successfully and browse to the existing version to select the table I want to write to, but when I attempt to add the feature I get an ArcObjects error that the version is not found.  I can import features successfully from sde.Default but none of the versions.  This occurs when using a direction connection with OS Authentication, but I can import features when using an sde connection file that specifies the version, but it’s not ideal and I’d like to determine why I’m having issues.  2. When using the ArcSDE Geodatabase reader with the option to create a child version and then do a reconcile and post + delete the child state options on the ArcSDE Geodatabase writer, the edits and the reconcile and post are successful but I get an error when the translation attempts to delete the

I tried converting a OBJ to GLTF.It got converted properly.But the gltf output is transparent.the mtl of OBJ is:newmtl textureNs 26.4d 1illum 2Kd 1 1 1Ka 0.2 0.2 0.2Ks 0 0 0map_Kd nzl_akl_003.png and the gltf output material is :"materials" : { "mat_0" : { "name" : "texture", "extensions" : { "KHR_materials_common" : { "technique" : "PHONG", "values" : { "ambient" : [ 0.2, 0.2, 0.2, 1 ], "diffuse" : "t_0", "specular" : [ 0, 0, 0, 1 ], "shininess" : 128 }, "transparent" : true } } },The transparency of the gltf is set true by default.How to change this while conversion.I dont want the model to be tr

I have a workbench that I have been using for several days. all of the sudden when I open the workbench it will not run. I discovered that the reader does not show the exposed autocad_od_entity_key available any longer.if i go to a new workbench and pull in the same data the field does appear.

Hi, I would like to convert a dwg file to shp file. The problem is that it contains a lot of attribute for each object. I want to convert the dwg file to shp where each object have the associated attribute value. Please see picture below. for example, "CJ" originate from a layer in CAD. I want that layer to have it own column in the attribute table for the SHP file.

Hi guys! I'm new to FME. So far the software seems great but I'm having an issue with the data in my database persisting. I have a setup where I've created a CSV reader connected to a Postgres writer. When I run it, everything is ran fine without errors. In the visual preview it shows that the Postgres database has been written to. HOWEVER, when I do a Select * From database in a separate SQL command line, nothing is showing up in my tables. Its as if its not legitimately writing into the database. The connections are right, and this is happening on a local Postgres database I have running. I'm thinking there may be a step I missed? I did this all pretty straight-forward without tinkering with customizations. If anyone could assist or point me to a step-by-step guide for achieving this I'd really appreciate it. I have found similar guides on youtube but nothing for exactly CSV to Postgres. Thanks all!

Hello there, I'm quite new to FME, and I'm trying to achieve an effective CityGML model of an historical city center in order to carry out energy analysis at urban scale.After some hard work, I managed to transform my Shape file into CityGML LOD2 by merging a set of tutorials and best practices, and the result is satisfying. But at the end of the process I still have a huge dubt: in my final model there is no trace of shared surfaces between buildings, which are extremely important for computation in my case. Building models are in fact "extruded" one by one, with no knowledge of their boundary conditions.I didn't find any reference about this problem, is there someone who could please help me?Thanks,Cristina

Hi I have a problem in FME desktop 2019.2 that i haven't been able to solve for a while. I have an XML response from one server API and i need to restructure it to Post it to another server on a regular time interval. I am having trouble flattening the XML out and holding the relationship to the parent. Sounds like a common question. I can see many people asking similar questions in the forum however I cannot apply the logic to solve my problem. I assume the solution lies somewhere in the reader or flatten settings. The number of children per entry varies as you will see in the example.In summary:Input is an xml file. I have created an example attached.I need to split this into 2 tables. The first is the client information. The second is the contacts. And the relationship needs to be maintained. I was hoping to use the <client> <name> as the unique key in both tables.Output required is 2 tables or XML files.I would really appreciate any help.

Hello, I am making corrections on dwg files, I currently have a problem in my output file (in Writer) it created several entities () as in the attached photos instead of a single entity () . Do you have a solution to prevent the entities of this layer from multiplying for no reason? the entities added are of the same layer: EP_PRO_SUPPORT The problem apparently comes from the creation of the file in Writer because in the previous step, at the level of the Transformers FeatureTypeFilter I have no problem on the entities of this layer in Data Inspector. In addition I have the same number of entities in Writer and Reader on this layer so there should not be any problems with these new entities which do not come out of nowhere. Here is my FME file to better understand:  thank you in advance

Hi all,  So this I thought would be a really simple task, but I am having issues bringing in an Excel spreadsheet into ArcGIS Portal. My end goal for this was to update an excel spreadsheet on our server, and get FME to send them changes through on a schedule to Portal, in turn updating a dashboard we have. Bear with me as I have tried lots of different things but to no avail, this is what I tried in a nutshell:Firstly I tried reading an excel spreadsheet, and then adding it as a new feature to Portal. The parameters I used were layer name as default and set geometry to arcgisonline_no_geom, as it isn't spatial data, and set writer mode to 'INSERT'. The two tables (geodatabase and hosted table) gets added to my Portal, but there is no data there, if I click on data tab or fields it just says "error". Looking at the FME log the only warning which might be the cause is in relation to SSL certificate "SSL certificate verification failed for host... HTTPS connect

Hi!I have a road network in a shapefile (polygons). When I read the shapefile, all the roundabouts become multipolygons. I assume this is because of a error with island detection. When I read the same shapefile using Civil3d (Autodesk) the roundabouts are perfect single polygons. I already tried it with a sdf and a gml, but the problems persist.Can someone please tell me what I am doing wrong.. This is a problem I have faced a lot of times, any help would be much appreciated! 

I am trying to write raster image to Azure SQL, I need to store four images in each record - the following formats: PNG, JPG, JP2. The writer works well - no errors during the writing, however, the stored images cannot be read in another program (no FME). Any comments regarding the correct way to import images into Azure SQL database... ?Thank you!

Hey, I am currently reading a feature layer from AGOL, processing the data and writing the edited data to a new feature layer. I have been able to extract the associated image attachments from my original table, but I am wondering if there is a way for me to insert these images to my output table? Can we write these images, i have a GUID of the feature i need it to be attached to, I just don't know if it is possible through FME.Any ideas?

Any ideas how would FME power be able to convert a 'decapitated' CAD file back to text?I have a PDF file which used to be a CAD drawing (not sure if Autodesk or Bentley) and it contains only a 'dropped/exploded' line segment geometry. I have managed to read it into FME as line geometries, rotate the page so that it's 'level' and use LineCombiner to join segments back to 'character shapes'.Now I have geometries as shown below (some are perfect characters, some are in 2-3 parts, like 'd or b') and have no idea how to turn it back into text. I tried exporting it to DGN but Microstation doesn't seem to have a function like that either (i.e. once you drop/explode a text to lines, there's only 'Undo' to help, no function to 'characterise' it again, that I found).Also tried rasterising it with ImageRasterizer and then calling a Tesseract to attempt OCR, but it notoriously returns 'No text found' regardless of resoluti

I'm using Geodatabase_SDE reader and writer with different connection files. I have one database "Operations" with user1 and another database "Data_Sources" with user2. They both support geometric data used in ArcGIS. I try to read from Operations.user1.featureclass1, and write to Data_Sources.user2.featureclass2. Operations.user1.featureclass1 is in a dataset "ops". I'm tryng to just write a standalone featureclass in Data_Sources, so i am leaving the Feature Dataset parameter as blank. However, seems that no matter what i try, the error keeps getting thrown that I can't do the operation because I'm not the database owner. And the log says it was trying to write Data_Sources.user2.featureclass2 to the Operations.Ops dataset.The message is:Geodatabase Writer: Creating feature class `User2.Featureclass2' in feature dataset 'Operations.User1.Ops'An error occurred while attempting to create the feature class 'User2.Featureclass

I'm trying to sort through huge amounts of data. I have already run a directory file reader and have a huge CSV full of all the possible files in a directory including their name, path and extension etc. I now would like to push those file types into a new folder. This is for non-spatial, so a different folder for csv's, xsl, xlsx, doc, jpeg etc etcBy doing this I can then investigate these futher. Work so far: Reader: Read all files in directory and sub-directory that are, for example, a .csv I get an error and it won't create the reader, so I create it as a single CSV and then change the directory to the folder with \\**\\* at the and so it looks through all sub-directories. Writer is set to Dynamic and the same file type. I get errors from any of the above workings. Alternatively I feel like the original csv I have with all the directories included (including file path and extension) could be utilised for this?When I pull that CSV in it shows up like this instead of bro

A customer has FME Cloud. But now they need to write to GDB (ArcObjects) for raster writing.How should we add ESRI support?

Hi, I have some WFS that each contain multiple layers. When I add them with a WFS reader I have to check the parameters. When I want to write them in a GDB I have to choose the parameters. But then I have 2 Writers.Is there a possibility of writing several layers in one GDB?Additionally I am interested if it is somehow possible to write the parameters/lLayers from different WFS in one GDB?

Hi Everyone,I am trying to convert Esri .gdb file to PostgreSQL v 11.5 with PostGIS extension of v 2.5,an error message appears (Error executing SQL command ('SELECT AddGeometryColumn('public', 'UtilityNetwork_EDD', 'geom', importfromesri, 'GEOMETRY', 3)'): 'ERROR: column "importfromesri" does not exist)Can anyone help in solving this issue ´, I have searched for the same problem but nothing helped me, thanks in advance

I have a remote postgres / postgis db that I'd like to import data using .sql file resulting from an FME translation. Something like ogr's PGDump format using the COPY methodKindest regards...

Hello,I have a simple workspace. I read a xml service, use datetime converter then write DB. It works perfectly in FME Dekstop but when I publish and schecule job to FME server I got error below. DateTimeConverter_Rejector (TestFactory): The clause 'TEST @Value(fme_rejection_code) != FEATURE_TABLE_SHIM_SUPPORT Yes' within 'FACTORY_DEF * TestFactory FACTORY_NAME DateTimeConverter_Rejector INPUT FEATURE_TYPE ___TOREJECTOR___ TEST @Value(fme_rejection_code) != FEATURE_TABLE_SHIM_SUPPORT Yes OUTPUT PASSED FEATURE_TYPE DateTimeConverter_<REJECTED> @RemoveAttributes(___fme_rejection_code___) OUTPUT FAILED FEATURE_TYPE DateTimeConverter_OUTPUT @RenameAttributes(FME_STRICT,fme_rejection_code,___fme_rejection_code___)' is incorrect. TEST must look like: TEST <value> <operator> <value> [ENCODED]I can not find how to configure test parameters of datetimeConverter or solve this issue.I look into comminity and knowledge sections of safe and on the internet bu