[Xastir] Using GeoPDF maps experience

[ZPO]

Floyd,

Posted in another thread....
-------------
I used: http://geonames.usgs.gov/apex/f?p=262:1:0

Which allowed me to easily request a listing for a full state, 24K scale,
and USTopo. From there you can download a CSV and strip it down to only the
current release (sort on "Version") and delete all the fields other than
the download link. From there I fed it into wget as: "wget -i filename -nd"
to download all the current GeoPDF USTopo files for a given state. I let it
run overnight. The map downloads ran at about 1.2-1.5Mb/s whether I had 1
state downloading or 5 states downloading concurrently. I let them run
overnight. 5 states completed in something around 10 hours (WA, OR, ID, MT,
UT)

I've been reading all the GeoPDF conversion threads with interest and
thought it should make a good project to leave running in the background
over the holidays. My end goal is a set of just the DRGs and a set of just
the Orthophotos converted to GeoTIFF. I will then publish them via
bittorrent and a private tracker so they can be downloaded by everyone and
used without having to go through all the steps.

Question - should I make them available as state-level bundles (single huge
file to download), or as individual files (1K-2K torrent files for larger
states)? Perhaps both? I'd like to make them efficient for others to grab
and seed once they've downloaded them.

Onward! :)

---------------

Once you've got the maps, you can unzip them all with "for a in `ls`; do
unzip $a; done" (assumes you've got them in a separate directory). I put
each state in its own directory and have unzip chewing on all 5 states
simultaneously. I didn't have the script delete the downloaded file just in
case something goes FUBAR. Once the unzip is done on a given state, I can
compare the count of the download files and the unzipped files.

On Mon, Dec 21, 2015 at 3:04 PM, Floyd Rodgers <kc5qbc at swbell.net> wrote:

> Could you post the details of what you are doing and exactly how. I would
> like to pull down and convert a state or two.
>
>
> On 12/20/2015 3:31 PM, ZPO wrote:
>
>> Answered my own question..
>>
>> All the files are zipped. Once unzipped they will have names of the form
>> "OR_Arlington_20140731_TM_geo.pdf".
>>
>> Now to let it work through a download of a few states.
>>
>> 73-KY9K/Brian
>>
>> On Sun, Dec 20, 2015 at 12:48 PM, ZPO <geekdownrange at gmail.com> wrote:
>>
>> I've figured out how to pull down a list of all the maps in a given state
>>> as a CSV file. I've trimmed the CSV file down to just the download link
>>> and
>>> have wget using it as an input file to download all the 7.5 minute maps
>>> for
>>> my state.
>>>
>>> The only issue is that the filenames are "download?item_id=5992569"
>>> (example) based on actual download link rather than the more friendly
>>> name
>>> of the map. While I could redo things a bit to run an individual wget for
>>> each file using the friendlier map name as the output filename, has
>>> anyone
>>> else gone down this road before and found a clean and elegant way to work
>>> around this?
>>>
>>> 73-KY9K/Brian
>>>
>>>
>>> On Sun, Dec 20, 2015 at 8:03 AM, Jason KG4WSV <kg4wsv at gmail.com> wrote:
>>>
>>>
>>>> On Dec 19, 2015, at 2:52 PM, Kurt <ksaves2 at sbcglobal.net> wrote:
>>>>>
>>>>> labels gets "too busy" and hard to read when zoomed down in a town for
>>>>>
>>>> instance, just drop out the mapset you don't want to use at the moment.
>>>>
>>>>
>>>>
>>>> Xastir has a couple of tools to help with this.
>>>>
>>>> First are the display levels, so you don't display busy/detailed maps at
>>>> higher levels. That's pretty easy, although you may need to play around
>>>> a
>>>> bit to get it just the way you like it.
>>>>
>>>> The other thing is editing the dbfawk if you're using a shapefile. You
>>>> can cause labels to not display even though features are still there,
>>>> and
>>>> depending on the data available in the shapefile cause smaller features
>>>> to
>>>> drop out at higher zoom levels.  This requires a bit more work, but if
>>>> you
>>>> have a dbfawk to start with its certainly doable.
>>>>
>>>> -Jason
>>>>
>>>>
>>>> _______________________________________________
>>>> Xastir mailing list
>>>> Xastir at lists.xastir.org
>>>> http://xastir.org/mailman/listinfo/xastir
>>>>
>>>>
>>>
>>> --
>>> ----------
>>> Society is, always has been, and always will be a structure for the
>>> exploitation and oppression of the majority through systems of political
>>> force dictated by an elite, enforced by thugs, uniformed or not, and
>>> upheld
>>> by a willful ignorance and stupidity on the part of the very majority
>>> whom
>>> the system oppresses.
>>> - Richard K. Morgan
>>> ----------
>>>
>>>
>>
>>
> _______________________________________________
> Xastir mailing list
> Xastir at lists.xastir.org
> http://xastir.org/mailman/listinfo/xastir
>



-- 
----------
Society is, always has been, and always will be a structure for the
exploitation and oppression of the majority through systems of political
force dictated by an elite, enforced by thugs, uniformed or not, and upheld
by a willful ignorance and stupidity on the part of the very majority whom
the system oppresses.
- Richard K. Morgan
----------