notebook.community

Edit and run

資料架構介紹

cateType-->level-->categoryID cateType=1 主題分類瀏覽 cateType=2 施政分類瀏覽

初步嘗試





In [1]:



    


import requests
import pandas as pd
import numpy as np



    











In [5]:



    


systemId="C103AV005"
res=requests.get("http://210.69.40.134/OpenFront/report/report_detail.jsp?sysId=%s" % systemId)
tables=pd.read_html(res.text)



    











In [7]:



    


data_table1= [one_table for one_table in tables ][2]
data_table1



    


















    
Out[7]:










  
    

      
      0
      1
      2
      3
      4
      5
      6
      7
      8
      9
      10
      11
      12
      13
      14
      15
      16
      17
      18
      19
      
    

  
  
    

      0 
             點閱次數：
                                                      73
        NaN
        NaN
         NaN
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      1 
            系統識別號：
                                               C103AV005
        NaN
        NaN
         NaN
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      2 
            計畫名稱 ：
                               參加第93屆TRB年會暨馬里蘭州蔔哥馬利郡工程參訪
        NaN
        NaN
         NaN
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      3 
             報告名稱：
                               參加第93屆TRB年會暨馬里蘭州蔔哥馬利郡工程參訪
        NaN
        NaN
         NaN
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      4 
           電子全文檔 ：
                                        C103AV005_01.doc
        NaN
        NaN
         NaN
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      5 
              附件檔：
                                                     NaN
        NaN
        NaN
         NaN
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      6 
           計畫主辦機關：
                                                   臺南市政府
        NaN
        NaN
         NaN
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      7 
       計劃主辦機關網站首頁：
                                                     NaN
        NaN
        NaN
         NaN
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      8 
             出國人員：
       出國人員名單  姓名 服務機關  服務單位  職稱  官職等 吳宗榮  臺南市政府  工務局...
         姓名
       服務機關
        服務單位
        職稱
       官職等
       吳宗榮
       臺南市政府
       工務局
        局長
       簡任(派)
      NaN
       鍾南豪
       臺南市政府
       工務局
        科長
       薦任(派)
      NaN
       黃瓊儀
      ...
    

    

      9 
                姓名
                                                    服務機關
       服務單位
         職稱
         官職等
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      10
               吳宗榮
                                                   臺南市政府
        工務局
         局長
       簡任(派)
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      11
               鍾南豪
                                                   臺南市政府
        工務局
         科長
       薦任(派)
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      12
               黃瓊儀
                                                   臺南市政府
        工務局
       機要秘書
       薦任(派)
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      13
               林玉茹
                                                   臺南市政府
        工務局
       正工程司
       薦任(派)
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      14
               黃郁誠
                                                   臺南市政府
        NaN
       幫工程司
       薦任(派)
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      15
             前往地區：
                                                      美國
        NaN
        NaN
         NaN
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      16
             參訪機關：
                                           美國馬里蘭州蒙哥馬利交通局
        NaN
        NaN
         NaN
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      17
             出國類別：
                          其他(參訪)（其他類別之出國報告係依各機關自訂管理方式處理）
        NaN
        NaN
         NaN
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      18
             出國期間：
                             民國103年01月11日 至 民國103年01月18日
        NaN
        NaN
         NaN
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      19
               備註：
                                                     NaN
        NaN
        NaN
         NaN
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      20
             報告日期：
                                            民國103年03月10日
        NaN
        NaN
         NaN
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      21
             主題分類：
                                                    交通建設
        NaN
        NaN
         NaN
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      22
             施政分類：
                                                   交通及建設
        NaN
        NaN
         NaN
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      23
              關鍵詞：
                                  TRB，PSI，蒙哥馬利郡交通局，華盛頓DC
        NaN
        NaN
         NaN
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      24
            報告書頁數：
                                                     42頁
        NaN
        NaN
         NaN
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

    

      25
           報告內容摘要：
       為參考全球最新的道路工程相關之技術、鋪面材料應用、道路作業先期規劃、工程施工品質管理等各面向...
        NaN
        NaN
         NaN
       NaN
       NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
         NaN
       NaN
       NaN
         NaN
      NaN
       NaN
      ...
    

  



26 rows × 37 columns



















In [8]:



    


res=requests.get("http://210.69.40.134/OpenFront/report/report_result.jsp?level=1&categoryId=1&cateType=1")
tables=pd.read_html(res.text)



    











In [20]:



    


data_table1= [one_table for one_table in tables if one_table.shape>=(3,3)][0]
data_table1



    


















    
Out[20]:










  
    

      
      0
      1
      2
      3
      4
      5
      6
      7
      8
    

  
  
    

      0 
       此為勾選此頁全部查詢結果的script, 您可以自行勾選您要的項目。  此為取消此頁全部您已...
       序號
           系統識別號
       點閱次數
                                             計畫名稱 [報告名稱]
         出國人員
        前往地區
                      出國期間
            報告日期
    

    

      1 
                                                     NaN
        1
       C103AV006
          7
                                           香港地區國際蘭展推介記者會
       陳俊安等3人
          香港
       103/02/24至103/02/25
             NaN
    

    

      2 
                                                     NaN
        2
       C103AV005
         73
       參加第93屆TRB年會暨馬里蘭州蔔哥馬利郡工程參訪[參加第93屆TRB年會暨馬里蘭州蔔哥馬利...
       吳宗榮等5人
          美國
       103/01/11至103/01/18
       103/03/10
    

    

      3 
                                                     NaN
        3
       C103AV002
        108
             2013年12月臺南市政府日本訪問團[2013年12月臺南市政府日本訪問團出國報告書]
       許和鈞等5人
          日本
       102/12/16至102/12/19
       103/01/23
    

    

      4 
                                                     NaN
        4
       C103AV001
         88
                  第六屆「海峽兩岸文化創意產業博覽會」[第六屆「海峽兩岸文化創意產業博覽會」]
       黃名亨等2人
        中國大陸
       102/10/24至102/10/29
       102/12/09
    

    

      5 
                                                     NaN
        5
       C103AV004
         75
       2013 20th ITS World Congress TOKYO （2013年日本東京第...
          李光益
          日本
       102/10/13至102/10/19
       103/01/17
    

    

      6 
                                                     NaN
        6
       C102AV018
        170
                              日本數位文創園區考察[日本數位文創園區考察參訪報告]
       王時思等3人
          日本
       102/10/06至102/10/09
       102/10/22
    

    

      7 
                                                     NaN
        7
       C102AV015
         82
       兩岸宗教文化交流活動－第四屆廣澤尊王文化旅遊節[兩岸宗教文化交流活動－第四屆廣澤尊王文化旅遊...
       戴鳳隆等2人
        中國大陸
       102/09/11至102/09/16
       102/10/01
    

    

      8 
                                                     NaN
        8
       C102AV022
        180
                 2013年9月5-8日臺南在地媒體港澳參訪團[本市在地媒體港澳參訪團出國報告]
       趙卿惠等4人
       香港等2國
       102/09/05至102/09/08
       102/11/26
    

    

      9 
                                                     NaN
        9
       C102AV023
        151
       第六屆亞太城市旅遊振興機構(TPO)年會[赴韓國大田參加 「第六屆亞太城市旅遊振興機構（TP...
       詹家銓等2人
          韓國
       102/09/04至102/09/07
       102/11/29
    

    

      10
                                                     NaN
       10
       C102AV020
        164
       參加2013年「第21屆海峽兩岸都市交通學術研討會」及參觀中國福建廈門及江蘇常州之公車捷運系...
       張政源等2人
        中國大陸
       102/08/13至102/08/18
       102/11/08
    

  



11 rows × 9 columns



















In [17]:



    


#找到案號
col=data_table1.values[1:,2]
for i in col: print i



    


















    






C103AV006
C103AV005
C103AV002
C103AV001
C103AV004
C102AV018
C102AV015
C102AV022
C102AV023
C102AV020

找總頁數





In [34]:



    


from bs4 import BeautifulSoup

soup = BeautifulSoup(res.text)
pageDropdown=soup.find("select", { "id" : "pageNo" }).find_all("option")
maxPage=max([ int(i['value']) for i in pageDropdown])
maxPage



    


















    
Out[34]:








35

















In [50]:



    


req_data={
          "cateType":1,
          "categoryId":1,
          "level":1,
          "pageNo":35,
          "jumpPage":"%E9%80%81%E5%87%BA"}
res=requests.post("http://210.69.40.134/OpenFront/report/report_result.jsp",data=req_data)
tables=pd.read_html(res.text,attrs={'class':'report_list'})
data_table1= [one_table for one_table in tables ]
data_table1



    


















    
Out[50]:








[                                                   0    1          2     3  \
0  此為勾選此頁全部查詢結果的script, 您可以自行勾選您要的項目。  此為取消此頁全部您已...   序號      系統識別號  點閱次數   
1                                                NaN  341  C09003034    11   

                                                4       5     6  \
0                                     計畫名稱 [報告名稱]    出國人員  前往地區   
1  加拿大考察及觀摩地方建設.觀光建設出國報告書[加拿大考察及觀摩地方建設.觀光建設出國報告書]  鄭清霖等8人   加拿大   

                   7          8  
0               出國期間        NaT  
1  90/06/19至90/06/27 1990-09-03  

[2 rows x 9 columns]]

















In [63]:



    


import requests
import pandas as pd
import numpy as np
import time
import csv


caseIDs=[]

#取得頁數 maxPage
res=requests.get("http://210.69.40.134/OpenFront/report/report_result.jsp?level=1&categoryId=1&cateType=1")
soup = BeautifulSoup(res.text)
pageDropdown=soup.find("select", { "id" : "pageNo" }).find_all("option")
maxPage=max([ int(i['value']) for i in pageDropdown])

#逐頁取得案號下載存檔
for i in range(1,maxPage+1):
    print "取得第%s頁" % i
    req_data={
          "cateType":1,
          "categoryId":1,
          "level":1,
          "pageNo":i,
          "jumpPage":"%E9%80%81%E5%87%BA"}
    res=requests.post("http://210.69.40.134/OpenFront/report/report_result.jsp",data=req_data)
    tables=pd.read_html(res.text,attrs={'class':'report_list'})
    data_table1= [one_table for one_table in tables][0]
    caseIDs.extend(data_table1.values[1:,2])
    print data_table1.values[1:,2]
    #print "靜候五秒"
    #time.sleep(5)
caseIDs

print "寫入csv檔"
with open('output.csv', 'w') as fp:
    a = csv.writer(fp, delimiter=',')
    for caseId in caseIDs: a.writerow([caseId])



    


















    






取得第1頁
[u'C103AV006' u'C103AV005' u'C103AV002' u'C103AV001' u'C103AV004'
 u'C102AV018' u'C102AV015' u'C102AV022' u'C102AV023' u'C102AV020']
取得第2頁
[u'C102AV021' u'C102AV019' u'C102AV011' u'C102AV017' u'C102AV006'
 u'C102AV014' u'C102AV013' u'C102AV010' u'C102AV009' u'C102AV016']
取得第3頁
[u'C102AV012' u'C102AV008' u'C102AV007' u'C102AV005' u'C102AV003'
 u'C102AV004' u'C101AV025' u'C102AV002' u'C101AV021' u'C101AV024']
取得第4頁
[u'C101AV018' u'C102AV001' u'C101AV020' u'C101AV019' u'C101AV023'
 u'C101AV016' u'C101AV013' u'C101AV012' u'C101AV014' u'C101AV015']
取得第5頁
[u'C101AV011' u'C101AV022' u'C101AV010' u'C101AV008' u'C101AV007'
 u'C100AV036' u'C101AV003' u'C101AV006' u'C101AV009' u'C101AV027']
取得第6頁
[u'C101AV005' u'C100AV038' u'C101AV004' u'C100AV037' u'C100AV032'
 u'C100AV035' u'C101AV001' u'C101AV002' u'C100AV034' u'C100AV031']
取得第7頁
[u'C100AV025' u'C101AV017' u'C100AV019' u'C100AV020' u'C100AV027'
 u'C100AV029' u'C100AV021' u'C100AV026' u'C100AV023' u'C100AV018']
取得第8頁
[u'C100AV004' u'C100AV015' u'C099AL316' u'C099AL320' u'C099AL317'
 u'C099AL326' u'C099AV492' u'C099AL323' u'C100AV014' u'C100AV012']
取得第9頁
[u'C100AV001' u'C100AV005' u'C100AV009' u'C099AV493' u'C100AV003'
 u'C100AV002' u'C099AV491' u'C099AV489' u'C099AV488' u'C099AL318']
取得第10頁
[u'C099AL315' u'C099AL311' u'C100AV011' u'C099AL328' u'C099AV490'
 u'C099AL325' u'C099AL314' u'C099AL310' u'C099AV487' u'C099AV486']
取得第11頁
[u'C099AV484' u'C099AV485' u'C09902287' u'C099AV483' u'C099AL327'
 u'C09902292' u'C099AV482' u'C099AV481' u'C099AV480' u'C099AL313']
取得第12頁
[u'C09902306' u'C09902045' u'C099AL309' u'C09902266' u'C09901528'
 u'C099AV479' u'C09901727' u'C100AV013' u'C09901474' u'C09901386']
取得第13頁
[u'C100AV008' u'C09901179' u'C09901299' u'C09901082' u'C09900911'
 u'C09901001' u'C09901584' u'C100AV006' u'C09804348' u'C09900364']
取得第14頁
[u'C09804143' u'C09900766' u'C09804142' u'C09804265' u'C09804140'
 u'C09900179' u'C09804296' u'C09900272' u'C09803773' u'C09803917']
取得第15頁
[u'C09900322' u'C09804195' u'C09803566' u'C09803821' u'C09803722'
 u'C09802888' u'C09900269' u'C09900093' u'C09803726' u'C09804295']
取得第16頁
[u'C09900377' u'C09802846' u'C09802729' u'C09802957' u'C09802697'
 u'C09900662' u'C09802629' u'C09802345' u'C09803459' u'C09803331']
取得第17頁
[u'C09801989' u'C09801988' u'C09802288' u'C09802126' u'C09802484'
 u'C09801570' u'C09801224' u'C09801498' u'C09801789' u'C09802401']
取得第18頁
[u'C09801587' u'C09801704' u'C09801245' u'C09800883' u'C09800841'
 u'C09801055' u'C09801404' u'C09800617' u'C09800664' u'C09800526']
取得第19頁
[u'C09801278' u'C09800918' u'C09801431' u'C09800789' u'C09800756'
 u'C09800790' u'C09800012' u'C09704316' u'C09800389' u'C09800641']
取得第20頁
[u'C09704350' u'C09800376' u'C09704202' u'C09800612' u'C09704033'
 u'C09800561' u'C09800476' u'C09800219' u'C09800173' u'C09704048']
取得第21頁
[u'C09704030' u'C09703888' u'C09701231' u'C09704078' u'C09703958'
 u'C09704262' u'C09703020' u'C09702779' u'C09702987' u'C09703940']
取得第22頁
[u'C09704176' u'C09704000' u'C09703342' u'C09702752' u'C09702368'
 u'C09702653' u'C09702027' u'C09702957' u'C09701889' u'C09702656']
取得第23頁
[u'C09702631' u'C09701821' u'C09701895' u'C09700997' u'C09701128'
 u'C09701146' u'C09700852' u'C09701910' u'C09701386' u'C09700771']
取得第24頁
[u'C09700428' u'C09603648' u'C09603647' u'C09701394' u'C09702109'
 u'C09700652' u'C09700274' u'C09700983' u'C09603292' u'C09603158']
取得第25頁
[u'C09700991' u'C09602175' u'C09602174' u'C09602965' u'C09602173'
 u'C09603348' u'C09602964' u'C09603662' u'C09603687' u'C09601548']
取得第26頁
[u'C09601884' u'C09601437' u'C09601496' u'C09601113' u'C09601436'
 u'C09600865' u'C09601314' u'C09503681' u'C09600097' u'C09503722']
取得第27頁
[u'C09600246' u'C09600182' u'C09600291' u'C09502644' u'C09503045'
 u'C09502390' u'C09503630' u'C09502195' u'C09503444' u'C09503242']
取得第28頁
[u'C09502464' u'C09501827' u'C09502071' u'C09502700' u'C09502275'
 u'C09502701' u'C09502239' u'C09501571' u'C09502516' u'C09502262']
取得第29頁
[u'C09502238' u'C09501753' u'C09500937' u'C09500118' u'C09500546'
 u'C09500519' u'C09500345' u'C09500112' u'C09405019' u'C09403240']
取得第30頁
[u'C09404886' u'C09404583' u'C09404483' u'C09404111' u'C09403867'
 u'C09403371' u'C09402747' u'C09402659' u'C09404062' u'C09403891']
取得第31頁
[u'C09403870' u'C09403888' u'C09402369' u'C09402967' u'C09403424'
 u'C09403356' u'C09403450' u'C09402612' u'C09401410' u'C09402086']
取得第32頁
[u'C09305627' u'C09304484' u'C09400375' u'C09400103' u'C09300003'
 u'C09303639' u'C09304949' u'C09304133' u'C09302109' u'C09303217']
取得第33頁
[u'C09302773' u'C09302354' u'C09301270' u'C09301248' u'C09300513'
 u'C09204309' u'C09204122' u'C09203127' u'C09105790' u'C09104928']
取得第34頁
[u'C09104743' u'C09102991' u'C09102714' u'C09102150' u'C09101093'
 u'C09100098' u'C09006788' u'C09004879' u'C09004137' u'C09005839']
取得第35頁
[u'C09003034']
寫入csv檔

取得個別案件內容





In [65]:



    


systemId="C103AV005"
res=requests.get("http://210.69.40.134/OpenFront/report/report_detail.jsp?sysId=%s" % systemId)
soup = BeautifulSoup(res.text)
table=soup.find("table", { "class" : "report_DATAtable" })
table



    


















    
Out[65]:








<table border="0" cellpadding="0" cellspacing="0" class="report_DATAtable" summary="資料表格">
<tr>
<th scope="row" width="25%"> 點閱次數： </th>
<td>75</td>
</tr>
<tr>
<th scope="row" width="25%"> 系統識別號： </th>
<td>C103AV005</td>
</tr>
<tr>
<th scope="row"> 計畫名稱 ：</th>
<td>參加第93屆TRB年會暨馬里蘭州蔔哥馬利郡工程參訪</td>
</tr>
<tr>
<th scope="row"> 報告名稱： </th>
<td>參加第93屆TRB年會暨馬里蘭州蔔哥馬利郡工程參訪</td>
</tr>
<tr>
<th scope="row"> 電子全文檔 ：</th>
<td>
<img align="absmiddle" alt="檔案格式doc" border="0" src="../images/FileType/icon_doc.gif"/><a href="show_file.jsp?sysId=C103AV005&amp;fileNo=1" title="另開視窗">C103AV005_01.doc</a>
    
     </td>
</tr>
<tr>
<th scope="row">附件檔：</th>
<td>
     

  </td>
</tr>
<tr>
<th scope="row"> 計畫主辦機關：</th>
<td>臺南市政府 </td>
</tr>
<tr>
<th scope="row"> 計劃主辦機關網站首頁：</th>
<td>
     </td>
</tr>
<tr>
<th scope="row"> 出國人員：</th>
<td>
<table border="0" cellpadding="0" cellspacing="0" class="simple_form2" summary="表格資料">
<caption align="left">出國人員名單</caption>
<tr align="center">
<th nowrap="" scope="col"> 姓名 </th>
<th nowrap="" scope="col"> 服務機關</th>
<th nowrap="" scope="col"> 服務單位</th>
<th nowrap="" scope="col"> 職稱</th>
<th nowrap="" scope="col"> 官職等 </th>
</tr>
<tr>
<td>吳宗榮</td>
<td>臺南市政府</td>
<td>工務局</td>
<td>局長</td>
<td>簡任(派)</td>
<td> </td>
</tr>
<tr>
<td>鍾南豪</td>
<td>臺南市政府</td>
<td>工務局</td>
<td>科長</td>
<td>薦任(派)</td>
<td> </td>
</tr>
<tr>
<td>黃瓊儀</td>
<td>臺南市政府</td>
<td>工務局</td>
<td>機要秘書</td>
<td>薦任(派)</td>
<td> </td>
</tr>
<tr>
<td>林玉茹</td>
<td>臺南市政府</td>
<td>工務局</td>
<td>正工程司</td>
<td>薦任(派)</td>
<td> </td>
</tr>
<tr>
<td>黃郁誠</td>
<td>臺南市政府</td>
<td></td>
<td>幫工程司</td>
<td>薦任(派)</td>
<td> </td>
</tr>
</table>
</td>
</tr>
<tr>
<th scope="row"> 前往地區：</th>
<td>美國</td>
</tr>
<tr>
<th scope="row"> 參訪機關：</th>
<td>美國馬里蘭州蒙哥馬利交通局 </td>
</tr>
<tr>
<th scope="row"> 出國類別：</th>
<td>其他(參訪)（其他類別之出國報告係依各機關自訂管理方式處理）</td>
</tr>
<tr>
<th> 出國期間：</th>
<td>民國103年01月11日 至 民國103年01月18日</td>
</tr>
<tr>
<th> 備註： </th>
<td> </td>
</tr>
<tr>
<th scope="row"> 報告日期： </th>
<td>民國103年03月10日 </td>
</tr>
<tr>
<th scope="row"> 主題分類： </th>
<td>交通建設 </td>
</tr>
<tr>
<th scope="row"> 施政分類： </th>
<td>交通及建設 </td>
</tr>
<tr>
<th scope="row"> 關鍵詞： </th>
<td>TRB，PSI，蒙哥馬利郡交通局，華盛頓DC </td>
</tr>
<tr>
<th scope="row"> 報告書頁數： </th>
<td>42頁</td>
</tr>
<tr>
<th scope="row"> 報告內容摘要： </th>
<td>為參考全球最新的道路工程相關之技術、鋪面材料應用、道路作業先期規劃、工程施工品質管理等各面向，以及參考先進國家目前使用之行政程序、發包制度及機具管理，本局遂經簽奉核准後派員參加TRB第93屆年會，並安排了前往美國馬里蘭州蒙哥馬利郡交通局之參訪1日，以及在華盛頓特區承攬道路工程規劃設計具30年歷史之工程顧問公司PSI之參訪1日，期能經由參訪、交流，學習，達到提升本局道路工程相關學識，導入最新工程施工及管理技術，最終提升工程品質的目標。 </td>
</tr>
</table>

















In [84]:



    


import os.path
processed=1
for systemId in caseIDs:
    filename='do_tainan/%s.txt' % systemId
    if os.path.isfile(filename):
        print "已有{0}({1}/{2})".format(filename, processed, len(caseIDs))
    else:
        print "正在處理{0}({1}/{2})" .format(str(systemId),processed, len(caseIDs))
        res=requests.get("http://210.69.40.134/OpenFront/report/report_detail.jsp?sysId=%s" % systemId)
        soup = BeautifulSoup(res.text)
        table=soup.find("table", { "class" : "report_DATAtable" })
        with open( filename, 'w') as myFile:
            myFile.write(table.prettify("utf-8"))
        # print "靜候五秒"
        # time.sleep(5)
    processed+=1



    


















    






已有do_tainan/C103AV006.txt(0/341)
已有do_tainan/C103AV005.txt(1/341)
已有do_tainan/C103AV002.txt(2/341)
已有do_tainan/C103AV001.txt(3/341)
已有do_tainan/C103AV004.txt(4/341)
已有do_tainan/C102AV018.txt(5/341)
已有do_tainan/C102AV015.txt(6/341)
已有do_tainan/C102AV022.txt(7/341)
已有do_tainan/C102AV023.txt(8/341)
已有do_tainan/C102AV020.txt(9/341)
已有do_tainan/C102AV021.txt(10/341)
已有do_tainan/C102AV019.txt(11/341)
已有do_tainan/C102AV011.txt(12/341)
已有do_tainan/C102AV017.txt(13/341)
已有do_tainan/C102AV006.txt(14/341)
已有do_tainan/C102AV014.txt(15/341)
已有do_tainan/C102AV013.txt(16/341)
已有do_tainan/C102AV010.txt(17/341)
已有do_tainan/C102AV009.txt(18/341)
已有do_tainan/C102AV016.txt(19/341)
已有do_tainan/C102AV012.txt(20/341)
已有do_tainan/C102AV008.txt(21/341)
已有do_tainan/C102AV007.txt(22/341)
已有do_tainan/C102AV005.txt(23/341)
已有do_tainan/C102AV003.txt(24/341)
已有do_tainan/C102AV004.txt(25/341)
已有do_tainan/C101AV025.txt(26/341)
已有do_tainan/C102AV002.txt(27/341)
已有do_tainan/C101AV021.txt(28/341)
已有do_tainan/C101AV024.txt(29/341)
已有do_tainan/C101AV018.txt(30/341)
已有do_tainan/C102AV001.txt(31/341)
已有do_tainan/C101AV020.txt(32/341)
已有do_tainan/C101AV019.txt(33/341)
已有do_tainan/C101AV023.txt(34/341)
已有do_tainan/C101AV016.txt(35/341)
已有do_tainan/C101AV013.txt(36/341)
已有do_tainan/C101AV012.txt(37/341)
已有do_tainan/C101AV014.txt(38/341)
已有do_tainan/C101AV015.txt(39/341)
已有do_tainan/C101AV011.txt(40/341)
已有do_tainan/C101AV022.txt(41/341)
已有do_tainan/C101AV010.txt(42/341)
已有do_tainan/C101AV008.txt(43/341)
已有do_tainan/C101AV007.txt(44/341)
已有do_tainan/C100AV036.txt(45/341)
已有do_tainan/C101AV003.txt(46/341)
已有do_tainan/C101AV006.txt(47/341)
已有do_tainan/C101AV009.txt(48/341)
已有do_tainan/C101AV027.txt(49/341)
已有do_tainan/C101AV005.txt(50/341)
已有do_tainan/C100AV038.txt(51/341)
已有do_tainan/C101AV004.txt(52/341)
已有do_tainan/C100AV037.txt(53/341)
已有do_tainan/C100AV032.txt(54/341)
已有do_tainan/C100AV035.txt(55/341)
已有do_tainan/C101AV001.txt(56/341)
已有do_tainan/C101AV002.txt(57/341)
已有do_tainan/C100AV034.txt(58/341)
已有do_tainan/C100AV031.txt(59/341)
已有do_tainan/C100AV025.txt(60/341)
已有do_tainan/C101AV017.txt(61/341)
已有do_tainan/C100AV019.txt(62/341)
已有do_tainan/C100AV020.txt(63/341)
已有do_tainan/C100AV027.txt(64/341)
已有do_tainan/C100AV029.txt(65/341)
已有do_tainan/C100AV021.txt(66/341)
已有do_tainan/C100AV026.txt(67/341)
已有do_tainan/C100AV023.txt(68/341)
已有do_tainan/C100AV018.txt(69/341)
已有do_tainan/C100AV004.txt(70/341)
已有do_tainan/C100AV015.txt(71/341)
已有do_tainan/C099AL316.txt(72/341)
已有do_tainan/C099AL320.txt(73/341)
已有do_tainan/C099AL317.txt(74/341)
已有do_tainan/C099AL326.txt(75/341)
已有do_tainan/C099AV492.txt(76/341)
已有do_tainan/C099AL323.txt(77/341)
已有do_tainan/C100AV014.txt(78/341)
已有do_tainan/C100AV012.txt(79/341)
已有do_tainan/C100AV001.txt(80/341)
已有do_tainan/C100AV005.txt(81/341)
已有do_tainan/C100AV009.txt(82/341)
已有do_tainan/C099AV493.txt(83/341)
已有do_tainan/C100AV003.txt(84/341)
已有do_tainan/C100AV002.txt(85/341)
已有do_tainan/C099AV491.txt(86/341)
已有do_tainan/C099AV489.txt(87/341)
已有do_tainan/C099AV488.txt(88/341)
已有do_tainan/C099AL318.txt(89/341)
已有do_tainan/C099AL315.txt(90/341)
已有do_tainan/C099AL311.txt(91/341)
已有do_tainan/C100AV011.txt(92/341)
已有do_tainan/C099AL328.txt(93/341)
已有do_tainan/C099AV490.txt(94/341)
已有do_tainan/C099AL325.txt(95/341)
已有do_tainan/C099AL314.txt(96/341)
已有do_tainan/C099AL310.txt(97/341)
已有do_tainan/C099AV487.txt(98/341)
已有do_tainan/C099AV486.txt(99/341)
已有do_tainan/C099AV484.txt(100/341)
已有do_tainan/C099AV485.txt(101/341)
已有do_tainan/C09902287.txt(102/341)
已有do_tainan/C099AV483.txt(103/341)
已有do_tainan/C099AL327.txt(104/341)
已有do_tainan/C09902292.txt(105/341)
已有do_tainan/C099AV482.txt(106/341)
已有do_tainan/C099AV481.txt(107/341)
已有do_tainan/C099AV480.txt(108/341)
已有do_tainan/C099AL313.txt(109/341)
已有do_tainan/C09902306.txt(110/341)
已有do_tainan/C09902045.txt(111/341)
已有do_tainan/C099AL309.txt(112/341)
已有do_tainan/C09902266.txt(113/341)
已有do_tainan/C09901528.txt(114/341)
已有do_tainan/C099AV479.txt(115/341)
已有do_tainan/C09901727.txt(116/341)
已有do_tainan/C100AV013.txt(117/341)
已有do_tainan/C09901474.txt(118/341)
已有do_tainan/C09901386.txt(119/341)
已有do_tainan/C100AV008.txt(120/341)
已有do_tainan/C09901179.txt(121/341)
已有do_tainan/C09901299.txt(122/341)
已有do_tainan/C09901082.txt(123/341)
已有do_tainan/C09900911.txt(124/341)
已有do_tainan/C09901001.txt(125/341)
已有do_tainan/C09901584.txt(126/341)
已有do_tainan/C100AV006.txt(127/341)
已有do_tainan/C09804348.txt(128/341)
已有do_tainan/C09900364.txt(129/341)
已有do_tainan/C09804143.txt(130/341)
已有do_tainan/C09900766.txt(131/341)
已有do_tainan/C09804142.txt(132/341)
已有do_tainan/C09804265.txt(133/341)
已有do_tainan/C09804140.txt(134/341)
已有do_tainan/C09900179.txt(135/341)
已有do_tainan/C09804296.txt(136/341)
已有do_tainan/C09900272.txt(137/341)
已有do_tainan/C09803773.txt(138/341)
已有do_tainan/C09803917.txt(139/341)
已有do_tainan/C09900322.txt(140/341)
已有do_tainan/C09804195.txt(141/341)
已有do_tainan/C09803566.txt(142/341)
已有do_tainan/C09803821.txt(143/341)
已有do_tainan/C09803722.txt(144/341)
已有do_tainan/C09802888.txt(145/341)
已有do_tainan/C09900269.txt(146/341)
已有do_tainan/C09900093.txt(147/341)
已有do_tainan/C09803726.txt(148/341)
已有do_tainan/C09804295.txt(149/341)
已有do_tainan/C09900377.txt(150/341)
已有do_tainan/C09802846.txt(151/341)
已有do_tainan/C09802729.txt(152/341)
已有do_tainan/C09802957.txt(153/341)
已有do_tainan/C09802697.txt(154/341)
已有do_tainan/C09900662.txt(155/341)
已有do_tainan/C09802629.txt(156/341)
已有do_tainan/C09802345.txt(157/341)
已有do_tainan/C09803459.txt(158/341)
已有do_tainan/C09803331.txt(159/341)
已有do_tainan/C09801989.txt(160/341)
已有do_tainan/C09801988.txt(161/341)
已有do_tainan/C09802288.txt(162/341)
已有do_tainan/C09802126.txt(163/341)
已有do_tainan/C09802484.txt(164/341)
已有do_tainan/C09801570.txt(165/341)
已有do_tainan/C09801224.txt(166/341)
已有do_tainan/C09801498.txt(167/341)
已有do_tainan/C09801789.txt(168/341)
已有do_tainan/C09802401.txt(169/341)
已有do_tainan/C09801587.txt(170/341)
已有do_tainan/C09801704.txt(171/341)
已有do_tainan/C09801245.txt(172/341)
已有do_tainan/C09800883.txt(173/341)
已有do_tainan/C09800841.txt(174/341)
已有do_tainan/C09801055.txt(175/341)
已有do_tainan/C09801404.txt(176/341)
已有do_tainan/C09800617.txt(177/341)
已有do_tainan/C09800664.txt(178/341)
已有do_tainan/C09800526.txt(179/341)
已有do_tainan/C09801278.txt(180/341)
已有do_tainan/C09800918.txt(181/341)
已有do_tainan/C09801431.txt(182/341)
已有do_tainan/C09800789.txt(183/341)
已有do_tainan/C09800756.txt(184/341)
已有do_tainan/C09800790.txt(185/341)
已有do_tainan/C09800012.txt(186/341)
已有do_tainan/C09704316.txt(187/341)
已有do_tainan/C09800389.txt(188/341)
已有do_tainan/C09800641.txt(189/341)
已有do_tainan/C09704350.txt(190/341)
已有do_tainan/C09800376.txt(191/341)
已有do_tainan/C09704202.txt(192/341)
已有do_tainan/C09800612.txt(193/341)
已有do_tainan/C09704033.txt(194/341)
已有do_tainan/C09800561.txt(195/341)
已有do_tainan/C09800476.txt(196/341)
已有do_tainan/C09800219.txt(197/341)
已有do_tainan/C09800173.txt(198/341)
已有do_tainan/C09704048.txt(199/341)
已有do_tainan/C09704030.txt(200/341)
已有do_tainan/C09703888.txt(201/341)
已有do_tainan/C09701231.txt(202/341)
已有do_tainan/C09704078.txt(203/341)
已有do_tainan/C09703958.txt(204/341)
已有do_tainan/C09704262.txt(205/341)
已有do_tainan/C09703020.txt(206/341)
已有do_tainan/C09702779.txt(207/341)
已有do_tainan/C09702987.txt(208/341)
正在處理C09703940(209/341)
正在處理C09704176(210/341)
正在處理C09704000(211/341)
正在處理C09703342(212/341)
正在處理C09702752(213/341)
正在處理C09702368(214/341)
正在處理C09702653(215/341)
正在處理C09702027(216/341)
正在處理C09702957(217/341)
正在處理C09701889(218/341)
正在處理C09702656(219/341)
正在處理C09702631(220/341)
正在處理C09701821(221/341)
正在處理C09701895(222/341)
正在處理C09700997(223/341)
正在處理C09701128(224/341)
正在處理C09701146(225/341)
正在處理C09700852(226/341)
正在處理C09701910(227/341)
正在處理C09701386(228/341)
正在處理C09700771(229/341)
正在處理C09700428(230/341)
正在處理C09603648(231/341)
正在處理C09603647(232/341)
正在處理C09701394(233/341)
正在處理C09702109(234/341)
正在處理C09700652(235/341)
正在處理C09700274(236/341)
正在處理C09700983(237/341)
正在處理C09603292(238/341)
正在處理C09603158(239/341)
正在處理C09700991(240/341)
正在處理C09602175(241/341)
正在處理C09602174(242/341)
正在處理C09602965(243/341)
正在處理C09602173(244/341)
正在處理C09603348(245/341)
正在處理C09602964(246/341)
正在處理C09603662(247/341)
正在處理C09603687(248/341)
正在處理C09601548(249/341)
正在處理C09601884(250/341)
正在處理C09601437(251/341)
正在處理C09601496(252/341)
正在處理C09601113(253/341)
正在處理C09601436(254/341)
正在處理C09600865(255/341)
正在處理C09601314(256/341)
正在處理C09503681(257/341)
正在處理C09600097(258/341)
正在處理C09503722(259/341)
正在處理C09600246(260/341)
正在處理C09600182(261/341)
正在處理C09600291(262/341)
正在處理C09502644(263/341)
正在處理C09503045(264/341)
正在處理C09502390(265/341)
正在處理C09503630(266/341)
正在處理C09502195(267/341)
正在處理C09503444(268/341)
正在處理C09503242(269/341)
正在處理C09502464(270/341)
正在處理C09501827(271/341)
正在處理C09502071(272/341)
正在處理C09502700(273/341)
正在處理C09502275(274/341)
正在處理C09502701(275/341)
正在處理C09502239(276/341)
正在處理C09501571(277/341)
正在處理C09502516(278/341)
正在處理C09502262(279/341)
正在處理C09502238(280/341)
正在處理C09501753(281/341)
正在處理C09500937(282/341)
正在處理C09500118(283/341)
正在處理C09500546(284/341)
正在處理C09500519(285/341)
正在處理C09500345(286/341)
正在處理C09500112(287/341)
正在處理C09405019(288/341)
正在處理C09403240(289/341)
正在處理C09404886(290/341)
正在處理C09404583(291/341)
正在處理C09404483(292/341)
正在處理C09404111(293/341)
正在處理C09403867(294/341)
正在處理C09403371(295/341)
正在處理C09402747(296/341)
正在處理C09402659(297/341)
正在處理C09404062(298/341)
正在處理C09403891(299/341)
正在處理C09403870(300/341)
正在處理C09403888(301/341)
正在處理C09402369(302/341)
正在處理C09402967(303/341)
正在處理C09403424(304/341)
正在處理C09403356(305/341)
正在處理C09403450(306/341)
正在處理C09402612(307/341)
正在處理C09401410(308/341)
正在處理C09402086(309/341)
正在處理C09305627(310/341)
正在處理C09304484(311/341)
正在處理C09400375(312/341)
正在處理C09400103(313/341)
正在處理C09300003(314/341)
正在處理C09303639(315/341)
正在處理C09304949(316/341)
正在處理C09304133(317/341)
正在處理C09302109(318/341)
正在處理C09303217(319/341)
正在處理C09302773(320/341)
正在處理C09302354(321/341)
正在處理C09301270(322/341)
正在處理C09301248(323/341)
正在處理C09300513(324/341)
正在處理C09204309(325/341)
正在處理C09204122(326/341)
正在處理C09203127(327/341)
正在處理C09105790(328/341)
正在處理C09104928(329/341)
正在處理C09104743(330/341)
正在處理C09102991(331/341)
正在處理C09102714(332/341)
正在處理C09102150(333/341)
正在處理C09101093(334/341)
正在處理C09100098(335/341)
正在處理C09006788(336/341)
正在處理C09004879(337/341)
正在處理C09004137(338/341)
正在處理C09005839(339/341)
正在處理C09003034(340/341)

















In [ ]:

Content source: ChihChengLiang/crawler_Tainan

Similar notebooks:

notebook.community | gallery | about