Skip to main content

Data

Using readers and writers to extract and load data.

  • 6,930 Posts
  • 25,494 Replies
6930 Posts
M
mantahia
asked in Data
create a json file from an excel file

Hello, l'm attempting to create a json file using a json existing file structure, with values coming from an excel file. (I didn't find example with json file not in input). My problem is that l want to fill json file only with key:value not null (as you can do in php..?) so that the key is not written in the json file. sorry for my bad english, this an example : if l managed to get from my excel file : title_fr : description in fr --> title templater "fr" : getattribute("title_fr"), title_en : null --> "en" : getattribut("title_en") In my title objet in the json file, l want : title { "fr" : "description in fr" } and not title { "fr" : "description in fr", "en" : "" } in order to have a clean json file especially when l expect to have a lot of null values depending of the case. Hope l was enough clear for you to help me!! thanks,

110
M
S
steelduck
asked in Data
Shape polygon to raster and then mosaic to raster

Hi, I have a shape file with a price for each polygon and I want to convert that to a raster in order to be able to mosaic these values to another raster. How is that possible? Many thanks!

220
S
R
ramu
asked in Data
importing tab file data to small world.

we are trying to import the object data to small world 4.3 from .tab file usnig FME work bench 2010. while running i am getting translation failed error. int the log file message Object unset does not understand message int!world_transform is displayed. so kidly let me know how to fix the issue.

20
R
K
khalid_omer
asked in Data
Datadownload serivce in FME server

Dear All , The uploaded files by the users get deleted before the process end , how to keep the uploaded file for a longer period . Also how to increase the performance of the datadownload services , it is taking one hour to report check conflict of an uploaded parcel againist all our store layers , is there is a way to speed up this , in arcmap when we found all intersect with this parcel it takes only 2 minuts .

50
david_r
Evangelist
S
subrat
asked in Data
Undefined macro `USER_ID' dereferenced in file error

Hi, I have 2 custom transformers embded in my main workbench. All are using same set of parameters. Hence, instead of each time changing all parameters, i tried to link parameters of 1st custom transformer to publish parameters of main workbench in Navigator. Workbench is executed successfully. but when i link any parameter of 2nd custom transformer, workbench is failing with following error. "Undefined macro `USER_ID' dereferenced in file `C:\\Users\\mypc\\AppData\\Local\\Temp\\FME_138424666970_7432' Undefined macro `%0' dereferenced in file `%1' ... Last line repeated 2 times ... Oracle Writer: Translation aborted -- rerun specifying "ORACLE8I_1_START_TRANSACTION 0"" 2nd custom transformer has one SQLExecutor, 1 test filter and 1 attribute creator. Please let me know how to solve this issue. Thanks.

290
david_r
Evangelist
sigtill
Contributor
sigtillContributor
asked in Data
Write GUID to ArcSDE Enterprise Geodatabase

I am generating new features in a workspace and wants to write to 2 already defines features in ArcSDE: Feature1: fme_feature_type: Road geodb_oid: 1 Feature2: fme_feature_type: RoadFeature geodb_oid: 2 MY_FOREIGN_KEY (guid): 1 The issue is that I only get an error when I try to insert Feature 2 in another table: |An error occurred while attempting to insert a value into the field 'MY_FOREIGN_KEY' for the table 'RoadFeature'. The error number from ArcObjects is: '-2147219887'. The error message from ArcObjects is: {}. I suspect i need the UUID from Feature1 to insert as the MY_FOREIGN_KEY in Feature2? However how can I do this when I am writing both features at the same time? I have other tables with M:M connections and a temporary geodb_oid on each object and a table describing the relationship and these goes through smoothly with correct connections in ArcSDE. Any suggestions what to try to be able to write to an attribute of type GUID in ArcSDE Enterprise?

270
sigtill
Contributor
mapnut
Participant
mapnutParticipant
asked in Data
FME Server and SDE

Hi All, I have just installed FME Server on a machine here at work (Build 13545) with only one engine - pretty simple huh? Well all is going fine so far, a test workbench which reads a TAB stored in a network location reads fine and writes to a local CSV. All good there. Then I upload a workbench which also writes a CSV locally, but reads from the Corporate SDE. Chaos ensues... The error message I am getting says: "Unable to perform any licensing related tasks. This is a 64-bit version of FME which requires a 64-bit version of ArcGIS Server" The issue is that ArcGIS Server IS 64 bit... Any suggestions?

90
mapnut
Participant
sigtill
Contributor
sigtillContributor
asked in Data
ArcSDE write Domain value

How to set Subtypes and Domains are written here: However how do I read the allowed subtypes from a feature? Ie for the "Diameter" attribute I want to extract the value:text pairs of choices (0:Unknown,12:12",2:2" etc...) Schemareader does not work as far as I have seen. http://fmepedia.safe.com/articles/How_To/Working-with-Geodatabase-Subtypes-and- Domains

280
sigtill
Contributor
D
dr_ysg
asked in Data
Pass a list of files to the JPEG reader?

I would like to to use the DirectoryAndFilePath Reader to assemble a list of file paths, and then feed tha to a JPEG reader as the list it should read. I have also looked at the FeatureReader, to see if it could be used under program control. But I am drawing a blank. Any hints?

100
D
G
giscos
asked in Data
ECW Smudging

Does anyone know of a fast and simple way to "smudge" an ECW file? I know this sounds strange but I essentially want to read a large ECW file and smudge it so that you cannot see any details within the resulting output ECW image. Any ideas? Thank you in advance.

160
fmelizard
Contributor
S
siggi
asked in Data
Transformation PostGIS to Bentley Microstation DGN V8

Hey all, I have a question about translating spatial data from a PostGIS database to Bentley Microstation DGN V8. Just to get an idea of what I am doing: the superior goal of my work is to store spatial data from DGN-V8-file in a central PostGIS-database, so that the spatial data can be accessed from any other place. So far, so good. The other way around, a DGN-V8-file should be the result when retrieving information from the PostGIS-database. The translation from DGN-V8 to PostGIS with FME works very well, all spatial information as well as additional attributes are transfered. On the way back, translating the PostGIS-tables to DGN-V8, the problem occures. All the geometry information gets into the new file as well as five attributes (igds_color, igds_weight, igds_style, igds_class, igds_graphic_group). But the rest of the attributes stored in the PostGIS database are ignored. They don't appear in the resulting DGN-V8-file. For instance, there is a table, which contain text informatio

190
david_r
Evangelist
A
aquamarine
asked in Data
3D DGN Elevations to Shapefiles

Hi, I have a 3D Microstation v8 DGN file which I need to convert to shapefile. How do i get the elevation data out of the DGN and into an attribute field in the shapefile? Thanks!

150
fmelizard
Contributor
L
lucho
asked in Data
Esrishape format

Hi, I have a doubt, Would it be possible to obtain the name of EsriShape file as an attribute of his reader? Thanks

100
L
M
martino
asked in Data
LAS file to 3D pdf

This question was asked in February by SWach I'm having the same problem as Sarah with writing point clouds to 3D PDF and retaining colour. I assign the colour from a raster using the PointCloudOnRasterComponentSetter transformer. Then Coerce to points preserving the colour as an attribute and use this attribute in PDFStyler to assign the colour. Stills comes out black. Sarah's soloution "I needed to add an ElevationExtractor, Bufferer and 3D Forcer between the PointCloudCoercer and PDFStyler." If you're out there Sarah can you explain how you used these transformers to assign the colour from the imagery that is accepted by 3D PDF? Anyone else with ideas? Martin

230
M
K
khalid_omer
asked in Data
Datadownload service not sending file geodatabase

Dear All , We are using datadownload service to extract data and sending it by email , output files excel and filegeodatabase , excel is zipped and sent by email , but file geodatabase is creaetd on the server but not zipped , that is why email is not contained the file geodatabase , is there is any reason for that. Thanks ,

50
K
swach
Contributor
swachContributor
asked in Data
LAS file to 3D pdf

Hello, I having issues creating a 3D pdf from a coloured LAS file. I can make the points display in the pdf but it is not displaying the colour of the points. What am I missing? Thanks Sarah Wach Manitoba Hydro

380
M
R
roy_martin
asked in Data
Authoring FME ETLs

I working within my organization to help fellow team members understand the differences between FME Workbench and FME Server. Could someone in the community provide an explanation of where FME ETL development occurs? Is it in FME Workbench; or, FME Server?

50
david_r
Evangelist
kimo
Contributor
kimoContributor
asked in Data
OLD CSV reader fails in 2013 SP4

When I go to run my scripts written in earlier versions the csv reader fails all features, but wastes time reading them all with no errors. After fiddling around for half a day I found a workaround. Delete the old reader and add a new one with the same parameters. Just saving the workbench in the new format is not enough. So I will have to edit every single script written that uses a CSV reader. Not Happy.

40
david_r
Evangelist
B
bernard
asked in Data
Writing to Oracle Spatial with apparently valid geometries - but are rejected by Oracle DB

Hello all I have had it several times, that i cannot write to Oracle Spatial DB apparently correct (at least by GeometryValidator Transformer) geometries. I can write these geometries with other writers (i tested ESRI shapes and ESRI geodatabase). I know that oracle has his own strict geometry validation rules. Strange enough, the ORA-Error echoed back (ORA 20263) is not a common error found here for example: http://docs.oracle.com/cd/B14117_01/server.101/b10744/toc.htm Is there a way to check before the insert, if a geometry is valid (in strict Oracle DB terms). Or is there a parameter within the writer that can catch the Ora-Error, skip the geometry, and continue the process of writing with the other pending geometries? I'm working with FME Desktop 2013 (20130124), DB is Oracle Spatial 10.2.0.4.0 Yes, you guessed right, english is not my native language. I appreciate your help. Bernard

223
fmelizard
Contributor
S
sverdloff
asked in Data
.TAB to GeoJson error

Hi there, I am doing a conversion from a .TAB file to a .JSON file. When i run the work bench normally it works fine. However, when i try to convert it to a batch file i get an error saying that it is unable to open output file. My reader is... G:\\spatial\\Manage\\ParkingBays\\Data\\PAT\\Road_Marking.TAB My writer is.... G:\\spatial\\Export\\External\\YellowLineParking\\Data\\Road_Marking.json and the error i get is....... Unable to open output file: 'G:\\spatial\\Export\\External\\YellowLineParking\\Data\\Road_Marking.json\\PAT' Can anyone explain to me how and why this error is occuring? Where does the "PAT" bit come from? And how can I stop it from happening? Many thanks in advance for your help. Matt

350
fmelizard
Contributor
mapnut
Participant
mapnutParticipant
asked in Data
MapInfo .MAP file sizes

Hi All, Encountered an interesting problem today... The background is that we are currently migrating from MapInfo to Esri and are in the process of migrating the data. With MapInfo on life support we need to provide users with the data now residing in the SDE back into TAB format. So to do this we've written quite a few workbenches. What we have noticed is that the .MAP file is consistantly 20-30% larger in size than the original .MAP before it went into the SDE. I would normally attribute this to picking up some extra "stuff" in the double translation process, but if you take the TAB into MapInfo and pack the table, the .MAP returns to it's original size... Very strange. Can any-one tell me why? It's not an issue (for me) but I would love to know what's going on!

160
francis_m
Contributor
F
fazsnatch
asked in Data
Layer/Shp/Geodatabase files - How to get this into a oracle table/database?

Hi guys, Pretty much written in subject. But got a few gis esri products. Shp, layer and geodatabases. I am wondering what is the best method to get these into a oracle database. Does anyone have any examples or point me into how to get this setup? Thank you

270
F
A
andy_b
asked in Data
Creating feature-linked annotations in an ESRI geodatabase

Hallo everyone, I tried a lot, but can't find a solution. I have a polyline feature class in a file geodatabase and want to create several annotations out of it. That means, the non-annotation-feature has already been written. Writing multiple annotation classes according to the feature's attributes is already possible in my workflow, but they are not feature-linked yet. It is stated here, that the "geodb_linked_feature_id" attribute connects the feature's Object ID to the ID of the annotations and thereby virtually the two datasets. But what am I supposed to enter in this field? When I choose the OBJECTID attribute of the polyline feature nothing happens. A second point that confuses me: If the polyline feature would not be already written, the documentary (here) tells me to use the 'geodb_text_feat_class_name' format attribute to link annotations to the feature. In the example, the annotation class name is entered for this attribute. But what does it help to enter the name of the des

741
A
R
rkay
asked in Data
Extracting parameters from an FME Server notification message

Hi all, I’m using FME Server and ActiveMQ to chain together a series of workbenches, running each in turn depending on the notification messages sent between FME Server and ActiveMQ (JMS). The notifications sent from ActiveMQ are JSONs with the parameters required by the workbench to run successfully. For example, the notification will contain Source Dataset, Coordinate System, File Type, etc. My problem is that I need to pass the parameters defined in the notification to the workbench at runtime and don’t know how to accomplish this when the notification is being read from an FME Server Topic. Initially I was going to use scripted parameters to read a json containing the required parameters from a url and extract the required information. This works really well if the notification and its endpoint is well defined but, now that I’m trying to read my notification message from an FME Server Topic, I don’t have a well defined JSON (notification message) to read from. As an alternative I t

300
R
A
almosttransform
asked in Data
Swiss Interlis 1 to Oracle no sdo_geometry column?

Hi Guys, I'm loading data from the Swiss interlis 1 reader (ili2fme) into Oracle Spatial Relational. All run fine but the oracle geometry is not created. Instead of this I have a my_table_sdgeom table created and inside a lot of columns and coordinates(sdo_X..). I'm a bit confuse because I would have expected the Oracle Spatial Relational writer to to create a sdo_geometry column. How can I create this sdo_geometry column? Regards!

50
A

Most helpful members this week

Badge winners

  • FME Form Basic Training
    roslonhas earned the badge FME Form Basic Training
  • English Speaker
    gis_midwesthas earned the badge English Speaker
  • Student (Grey)
    vdeyepchas earned the badge Student (Grey)
  • Socializer (Ice Breaker)
    jdandriessenhas earned the badge Socializer (Ice Breaker)
  • Conversationalist
    jdandriessenhas earned the badge Conversationalist
Show all badges
30,840
Posts
Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.