The following spatial data are available from NHGIS.org
1890 States
45 States : Alabama, Arkansas, California, Colorado, Connecticut, Delaware, District of Columbia, Florida, Georgia, Idaho, Illinois, Indiana, Iowa, Kansas, Kentucky, Louisiana, Maine, Maryland, Massachusetts, Michigan, Minnesota, Mississippi, Missouri, Nebraska, Nevada, New Hampshire, New Jersey, New York, North Carolina, North Dakota, Ohio, Oregon, Pennsylvania, Rhode Island, South Carolina, South Dakota, Tennessee, Texas, Vermont, Virginia, Washington, West Virginia, Wisconsin, Wyoming.
6 Territories : Alaska Territory, Arizona Territory, Indian Territory, New Mexico Territory, Oklahoma Territory, Utah Territory
1890 Counties
2614 Counties : Some Counties and districts contain no population data.