Renaming columns using geopandas - issues with data table in ArcGeoPandas to_file() saves GeoDataFrame without coordinate systemFrom text data create a FeatureClass with table with pythonSpeed up row-wise point in polygon with GeopandasRenaming shapefiles using loop in PythonGeopandas: Write layer back into GeoDataBaseConverting shapefile data to .osm using ogr2osmGeopandas not recognizing geometry typeHow do I write a GeoPandas dataframe into a single file (preferably JSON or GeoPackage)?gdal/geopandas data object compatibility in pythonSorting (ORDER BY) rows from Shapefile using Python?How to create a shapefile [polygon type] from a Geodataframe, returned from a Oracle Spatial cursor with geometry column type=cx_Oracle.LOB?
Gears on left are inverse to gears on right?
How do scammers retract money, while you can’t?
How to write papers efficiently when English isn't my first language?
Nautlius: add mouse right-click action to compute MD5 sum
Applicability of Single Responsibility Principle
How to pronounce the slash sign
Valid Badminton Score?
Does "every" first-order theory have a finitely axiomatizable conservative extension?
Overloading istream>> to read comma-separated input
Why is Lord Kartikeya called 'Devasenapati'?
Why Were Madagascar and New Zealand Discovered So Late?
How did Doctor Strange see the winning outcome in Avengers: Infinity War?
Implement the Thanos sorting algorithm
Italian words for tools
Type int? vs type int
What Brexit proposals are on the table in the indicative votes on the 27th of March 2019?
Are student evaluations of teaching assistants read by others in the faculty?
How can we prove that any integral in the set of non-elementary integrals cannot be expressed in the form of elementary functions?
How can I get through very long and very dry, but also very useful technical documents when learning a new tool?
Avoiding estate tax by giving multiple gifts
Is it okay for two “sein” to be next to each other?
Lay out the Carpet
You cannot touch me, but I can touch you, who am I?
Why, precisely, is argon used in neutrino experiments?
Renaming columns using geopandas - issues with data table in Arc
GeoPandas to_file() saves GeoDataFrame without coordinate systemFrom text data create a FeatureClass with table with pythonSpeed up row-wise point in polygon with GeopandasRenaming shapefiles using loop in PythonGeopandas: Write layer back into GeoDataBaseConverting shapefile data to .osm using ogr2osmGeopandas not recognizing geometry typeHow do I write a GeoPandas dataframe into a single file (preferably JSON or GeoPackage)?gdal/geopandas data object compatibility in pythonSorting (ORDER BY) rows from Shapefile using Python?How to create a shapefile [polygon type] from a Geodataframe, returned from a Oracle Spatial cursor with geometry column type=cx_Oracle.LOB?
What I'm trying to achieve:
- Read in an existing ESRI polygon shapefile
- Drop an attribute
- Dissolve by another attribute
- Rename columns
- Reorder columns
- Write out as new shapefile
What works: Drop column and dissolve all work - I've run these steps and written to file. This opens fine in ArcMap, I can identify things, open the attribute table etc. No issues.
Problem: When I rename (not got to the reorder step without error yet) the columns, everything runs fine and I write to file. When then opening the shapefile in ArcMap (10.3.1) I can query layers using the Identify cursor which shows my renamed attributes as they should be BUT when trying to open the attribute table, I get the following message in a window:
Loading table data
Could not load data from the data source. If you can correct the problem, press the refresh button to reload data. Possible problems can include bad network connection, invalid file, etc.
A column was specified that doesn't exists.
A column was specified that doesn't exists.
So, it looks like something is missing or my changes are not being mapped across the shapefile components. I can't share the data but can share the code. The problem is with the renaming... What am I missing?
import geopandas as gp
# Read data in
f="my_file"
data = gp.read_file(f)
# Drop a column (if writing out file here, does as expected)
data=data.drop(['CLASS'], axis=1)
# Do the dissolve (if writing out file here, does as expected)
data=data.dissolve(by='Hazard_Pot', as_index=False)
# Rename (THE PROBLEM I THINK : if saving here, I get my issue in ArcMap)
data=data.rename(index=str, columns="Hazard_Pot":"Potential",
"casualties":"Casualty",
"vehicle_ac":"Access",
"building d":"Damage",
"disruption":"Disruption",
"contaminat":"Contam.",
"do_not_1":"Do_Not_1")
# Reorder
data=data[['Potential',
'Casualty',
'Access',
'Damage',
'Disruption',
'Contam.',
'Do_Not_1',
'geometry']]
# write to file (creating a new CRS based on the old as per https://gis.stackexchange.com/questions/204201/geopandas-to-file-saves-geodataframe-without-coordinate-system?noredirect=1&lq=1)
prj_file = "%s.prj" %os.path.splitext(f)[0]
prj = [l.strip() for l in open(prj_file,'r')][0]
data.to_file(ofile, driver=driver, crs_wkt=prj)
python shapefile geopandas
add a comment |
What I'm trying to achieve:
- Read in an existing ESRI polygon shapefile
- Drop an attribute
- Dissolve by another attribute
- Rename columns
- Reorder columns
- Write out as new shapefile
What works: Drop column and dissolve all work - I've run these steps and written to file. This opens fine in ArcMap, I can identify things, open the attribute table etc. No issues.
Problem: When I rename (not got to the reorder step without error yet) the columns, everything runs fine and I write to file. When then opening the shapefile in ArcMap (10.3.1) I can query layers using the Identify cursor which shows my renamed attributes as they should be BUT when trying to open the attribute table, I get the following message in a window:
Loading table data
Could not load data from the data source. If you can correct the problem, press the refresh button to reload data. Possible problems can include bad network connection, invalid file, etc.
A column was specified that doesn't exists.
A column was specified that doesn't exists.
So, it looks like something is missing or my changes are not being mapped across the shapefile components. I can't share the data but can share the code. The problem is with the renaming... What am I missing?
import geopandas as gp
# Read data in
f="my_file"
data = gp.read_file(f)
# Drop a column (if writing out file here, does as expected)
data=data.drop(['CLASS'], axis=1)
# Do the dissolve (if writing out file here, does as expected)
data=data.dissolve(by='Hazard_Pot', as_index=False)
# Rename (THE PROBLEM I THINK : if saving here, I get my issue in ArcMap)
data=data.rename(index=str, columns="Hazard_Pot":"Potential",
"casualties":"Casualty",
"vehicle_ac":"Access",
"building d":"Damage",
"disruption":"Disruption",
"contaminat":"Contam.",
"do_not_1":"Do_Not_1")
# Reorder
data=data[['Potential',
'Casualty',
'Access',
'Damage',
'Disruption',
'Contam.',
'Do_Not_1',
'geometry']]
# write to file (creating a new CRS based on the old as per https://gis.stackexchange.com/questions/204201/geopandas-to-file-saves-geodataframe-without-coordinate-system?noredirect=1&lq=1)
prj_file = "%s.prj" %os.path.splitext(f)[0]
prj = [l.strip() for l in open(prj_file,'r')][0]
data.to_file(ofile, driver=driver, crs_wkt=prj)
python shapefile geopandas
data.rename(index=str...renaming the index to a data type is very strange. Take that part out and report back
– Paul H
5 hours ago
I can't share the data but can share the codeand you can share fake data that reproduces the issue
– Paul H
5 hours ago
@PaulH i beliveindex=stris correct syntax, see the examples in help section of rename. But I also think that part is not needed.
– BERA
5 hours ago
@BERA Oops - forgot rename could take callables.
– Paul H
4 hours ago
add a comment |
What I'm trying to achieve:
- Read in an existing ESRI polygon shapefile
- Drop an attribute
- Dissolve by another attribute
- Rename columns
- Reorder columns
- Write out as new shapefile
What works: Drop column and dissolve all work - I've run these steps and written to file. This opens fine in ArcMap, I can identify things, open the attribute table etc. No issues.
Problem: When I rename (not got to the reorder step without error yet) the columns, everything runs fine and I write to file. When then opening the shapefile in ArcMap (10.3.1) I can query layers using the Identify cursor which shows my renamed attributes as they should be BUT when trying to open the attribute table, I get the following message in a window:
Loading table data
Could not load data from the data source. If you can correct the problem, press the refresh button to reload data. Possible problems can include bad network connection, invalid file, etc.
A column was specified that doesn't exists.
A column was specified that doesn't exists.
So, it looks like something is missing or my changes are not being mapped across the shapefile components. I can't share the data but can share the code. The problem is with the renaming... What am I missing?
import geopandas as gp
# Read data in
f="my_file"
data = gp.read_file(f)
# Drop a column (if writing out file here, does as expected)
data=data.drop(['CLASS'], axis=1)
# Do the dissolve (if writing out file here, does as expected)
data=data.dissolve(by='Hazard_Pot', as_index=False)
# Rename (THE PROBLEM I THINK : if saving here, I get my issue in ArcMap)
data=data.rename(index=str, columns="Hazard_Pot":"Potential",
"casualties":"Casualty",
"vehicle_ac":"Access",
"building d":"Damage",
"disruption":"Disruption",
"contaminat":"Contam.",
"do_not_1":"Do_Not_1")
# Reorder
data=data[['Potential',
'Casualty',
'Access',
'Damage',
'Disruption',
'Contam.',
'Do_Not_1',
'geometry']]
# write to file (creating a new CRS based on the old as per https://gis.stackexchange.com/questions/204201/geopandas-to-file-saves-geodataframe-without-coordinate-system?noredirect=1&lq=1)
prj_file = "%s.prj" %os.path.splitext(f)[0]
prj = [l.strip() for l in open(prj_file,'r')][0]
data.to_file(ofile, driver=driver, crs_wkt=prj)
python shapefile geopandas
What I'm trying to achieve:
- Read in an existing ESRI polygon shapefile
- Drop an attribute
- Dissolve by another attribute
- Rename columns
- Reorder columns
- Write out as new shapefile
What works: Drop column and dissolve all work - I've run these steps and written to file. This opens fine in ArcMap, I can identify things, open the attribute table etc. No issues.
Problem: When I rename (not got to the reorder step without error yet) the columns, everything runs fine and I write to file. When then opening the shapefile in ArcMap (10.3.1) I can query layers using the Identify cursor which shows my renamed attributes as they should be BUT when trying to open the attribute table, I get the following message in a window:
Loading table data
Could not load data from the data source. If you can correct the problem, press the refresh button to reload data. Possible problems can include bad network connection, invalid file, etc.
A column was specified that doesn't exists.
A column was specified that doesn't exists.
So, it looks like something is missing or my changes are not being mapped across the shapefile components. I can't share the data but can share the code. The problem is with the renaming... What am I missing?
import geopandas as gp
# Read data in
f="my_file"
data = gp.read_file(f)
# Drop a column (if writing out file here, does as expected)
data=data.drop(['CLASS'], axis=1)
# Do the dissolve (if writing out file here, does as expected)
data=data.dissolve(by='Hazard_Pot', as_index=False)
# Rename (THE PROBLEM I THINK : if saving here, I get my issue in ArcMap)
data=data.rename(index=str, columns="Hazard_Pot":"Potential",
"casualties":"Casualty",
"vehicle_ac":"Access",
"building d":"Damage",
"disruption":"Disruption",
"contaminat":"Contam.",
"do_not_1":"Do_Not_1")
# Reorder
data=data[['Potential',
'Casualty',
'Access',
'Damage',
'Disruption',
'Contam.',
'Do_Not_1',
'geometry']]
# write to file (creating a new CRS based on the old as per https://gis.stackexchange.com/questions/204201/geopandas-to-file-saves-geodataframe-without-coordinate-system?noredirect=1&lq=1)
prj_file = "%s.prj" %os.path.splitext(f)[0]
prj = [l.strip() for l in open(prj_file,'r')][0]
data.to_file(ofile, driver=driver, crs_wkt=prj)
python shapefile geopandas
python shapefile geopandas
asked 5 hours ago
ChrisWillsChrisWills
506
506
data.rename(index=str...renaming the index to a data type is very strange. Take that part out and report back
– Paul H
5 hours ago
I can't share the data but can share the codeand you can share fake data that reproduces the issue
– Paul H
5 hours ago
@PaulH i beliveindex=stris correct syntax, see the examples in help section of rename. But I also think that part is not needed.
– BERA
5 hours ago
@BERA Oops - forgot rename could take callables.
– Paul H
4 hours ago
add a comment |
data.rename(index=str...renaming the index to a data type is very strange. Take that part out and report back
– Paul H
5 hours ago
I can't share the data but can share the codeand you can share fake data that reproduces the issue
– Paul H
5 hours ago
@PaulH i beliveindex=stris correct syntax, see the examples in help section of rename. But I also think that part is not needed.
– BERA
5 hours ago
@BERA Oops - forgot rename could take callables.
– Paul H
4 hours ago
data.rename(index=str... renaming the index to a data type is very strange. Take that part out and report back– Paul H
5 hours ago
data.rename(index=str... renaming the index to a data type is very strange. Take that part out and report back– Paul H
5 hours ago
I can't share the data but can share the code and you can share fake data that reproduces the issue– Paul H
5 hours ago
I can't share the data but can share the code and you can share fake data that reproduces the issue– Paul H
5 hours ago
@PaulH i belive
index=str is correct syntax, see the examples in help section of rename. But I also think that part is not needed.– BERA
5 hours ago
@PaulH i belive
index=str is correct syntax, see the examples in help section of rename. But I also think that part is not needed.– BERA
5 hours ago
@BERA Oops - forgot rename could take callables.
– Paul H
4 hours ago
@BERA Oops - forgot rename could take callables.
– Paul H
4 hours ago
add a comment |
1 Answer
1
active
oldest
votes
Looking at your code I can see two things that Arcmap doesn't like:
- The first one is the space in the field name
"building d"; - The second one - and the cause of the error - is the
.in"contaminat":"Contam.".
I was able to reproduce the error by creating a test file and using your code. Removing the dot "contaminat":"Contam" solved the problem.
New contributor
Mouad Alami is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "79"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fgis.stackexchange.com%2fquestions%2f316876%2frenaming-columns-using-geopandas-issues-with-data-table-in-arc%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Looking at your code I can see two things that Arcmap doesn't like:
- The first one is the space in the field name
"building d"; - The second one - and the cause of the error - is the
.in"contaminat":"Contam.".
I was able to reproduce the error by creating a test file and using your code. Removing the dot "contaminat":"Contam" solved the problem.
New contributor
Mouad Alami is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
Looking at your code I can see two things that Arcmap doesn't like:
- The first one is the space in the field name
"building d"; - The second one - and the cause of the error - is the
.in"contaminat":"Contam.".
I was able to reproduce the error by creating a test file and using your code. Removing the dot "contaminat":"Contam" solved the problem.
New contributor
Mouad Alami is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
Looking at your code I can see two things that Arcmap doesn't like:
- The first one is the space in the field name
"building d"; - The second one - and the cause of the error - is the
.in"contaminat":"Contam.".
I was able to reproduce the error by creating a test file and using your code. Removing the dot "contaminat":"Contam" solved the problem.
New contributor
Mouad Alami is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
Looking at your code I can see two things that Arcmap doesn't like:
- The first one is the space in the field name
"building d"; - The second one - and the cause of the error - is the
.in"contaminat":"Contam.".
I was able to reproduce the error by creating a test file and using your code. Removing the dot "contaminat":"Contam" solved the problem.
New contributor
Mouad Alami is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
Mouad Alami is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
answered 4 hours ago
Mouad AlamiMouad Alami
894
894
New contributor
Mouad Alami is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
Mouad Alami is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
Mouad Alami is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
add a comment |
Thanks for contributing an answer to Geographic Information Systems Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fgis.stackexchange.com%2fquestions%2f316876%2frenaming-columns-using-geopandas-issues-with-data-table-in-arc%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
data.rename(index=str...renaming the index to a data type is very strange. Take that part out and report back– Paul H
5 hours ago
I can't share the data but can share the codeand you can share fake data that reproduces the issue– Paul H
5 hours ago
@PaulH i belive
index=stris correct syntax, see the examples in help section of rename. But I also think that part is not needed.– BERA
5 hours ago
@BERA Oops - forgot rename could take callables.
– Paul H
4 hours ago