<font size="46">OpenStreetMap and Wikidata: the Shining and Corporated Open Content Projects together</font>

# <font size="46">OpenStreetMap and Wikidata: the Shining and Corporated Open Content Projects together</font>  slide: [https://hackmd.io/@osm-tw/S1m-yXJLs](https://hackmd.io/@osm-tw/S1m-yXJLs)  State of the Map Asia 2023 Dennis Raylin Chen Note: Ta̍k-ke hó, Hello everyone, This is Dennis Raylin Chen from Taiwan, I want to talk about cleaning and managing dataset. My speech's title is "Linking OpenStreetmap and Wikidata: Case study of Taiwan's villages and rivers datasets" ---  - Supaplex - [OpenStreetMap](https://www.openstreetmap.org/user/Supaplex) :heart: [Wikidata](https://www.wikidata.org/wiki/User:Supaplex) :heart: - [Data Working Group](https://osmfoundation.org/wiki/Data_Working_Group) - [WikidataCon 2023](https://wikidatacon.tw/) organizated team - [Wikimedia Taiwan](https://meta.wikimedia.org/wiki/Wikimedia_Taiwan/zh) :cat: Note: My online ID is Supaplex, mostly active on OpenStreetMap and Wikidata. Recently I just organized WikidataCon with Wikidata Taiwan and Wikimedia Deutschland. So I add the promotion material as background image in my slide. I am also a member of Wikimeida Taiwan --- ## Outline  * OpenStreetMap and Wikidata * Villages: all done! * rivers: linking with government ref * name suggestion index: chain stores * school: mostly metadata editing Note: Here is today's speech outline. I will talk about some general information of OpenStreetMap and Wikidata in Taiwan. Then the villages dataset, rivers dataset, school dataset, and the global OpenStreetMap community maintained name suggestion index. --- ## Our Venue  ![圖片](https://hackmd.io/_uploads/BkcAS9XVa.png) Note: I add the University's Wikidata and Wikipedia link on OpenStreetMap --- ## [OpenStreetMap Taiwan(Q104641278)](https://www.wikidata.org/wiki/Q104641278) & [Wikidata Taiwan(Q65555605)](https://www.wikidata.org/wiki/Q65555605)  * Monthly Meetup in Taipei, co-host of OpenStreetMap Taiwan and Wikidata Taiwan * members overlapped with each other * Major change monitor and mapping, tagging scheme discussion Note: I am one of the co-host of the monthly meetup in Taiwan, co-hosted with Wikidata Taiwan community. There are a hugh overlapped of community members between Wikidata and OpenStreetMap in Taiwan. The OpenStreetMap Taiwan community keep track of major development site, and sometimes discuss tagging scheme of mapping in Taiwan. --- ## Keep track of vandlism of Taiwan and recovery  **easy spotted by QA Tools like Osmcha** ![](https://i.imgur.com/yLDU1uP.jpg =560x) Note: It is quite easy to spot vandlism by varies QA tools --- ## Keep track of vandlism of Taiwan and recovery  ![](https://i.imgur.com/H4baf3c.png =560x) Note: The most annoying stuff is unhappy Chinese people adding notes or claimed China owns Taiwan. --- ## Cross Taiwan Strait Railway planned only by China  ![](https://i.imgur.com/k8tRdw9.png =560x) Note: Sometimes Chinese people are making unrealistic edit, for example, cross Taiwan Strait Railway. It might be possible to add as proposal status, but most editor not aware about it. Might have trouble to distigish real and imagal status --- ## Last year: River, villiages and cemetery  * Wikidata Birthday 2022 Taiwan: [Wikidata 串接 OpenStreetMap 的嘗試](https://hackmd.io/@wikidata-tw/H1Vebdp-o) * COSCUP 2022: [OpenStreetMap 佮 Wikidata 資料標準化的過程-溪流佮村里的例](https://hackmd.io/@osm-tw/rJ61y7-O9) * COSCUP 2021: [OpenStreetMap 佮 Wikidata，敢會當整理台灣所有溪流資料](/d017K1UJTai0QR7s8Jr2bw) * HOT Summit：[Using OpenStreetMap and Wikidata to arrange river data in Taiwan](https://hackmd.io/@osm-tw/ByEYs5kLY) * Wikidata Con：[Using OpenStreetMap and Wikidata to arrange river data in Taiwan](https://hackmd.io/@wikidata-tw/rJZbfxYBF) * Cemetery Conference：[DRGPA 2021第五屆研究記錄亞太墓地研討會](/h1u4K9sZQViud0AP1nyK2Q)、[文化與自然地理記錄工作坊](/dn9E5hS4RXe7tD-_OlJsyw) Note: Last year in one of the most important open source conference COSCUP in Taiwan, and also some related conference like Wikidata Con, HOT summit, I talked about cleaning, mapping and managing data about river, village and cemetery in Taiwan --- ## Wikidata History  * Start in 2012 * 2018: [Wikidata Lexeme](https://www.wikidata.org/wiki/Wikidata:Lexicographical_data) * First Wikidatacon in 2019 * 2023: [WikidataCon](https://wikidatacon.tw/) in Taipei and online --- ## The Beginning in Taiwan - WMDE Lydia's talks on COSCUP 2013  {%youtube dE52LLcUhYk %} Note: Wikimedia Deutschland, Wikidata 專案經理 Lydia 來台灣紹介 Wikidata，是臺灣上早的 Wikidata 演講 --- ## The history of Wikidata Taiwan  * 2014~2019: academic have more interest * 2019: some community members start to follow. ex: OpenStreetMap x Wikidata Monthly meetup * Mass import of Laws, Villages ,schools, libraries, episodes of drama, government published books, academic articles Note: 毋過到 2019 進前，臺灣遮較無系統的推捒 Wikidata。2019 年開始有社群聚會，嘛有先對藝術資料，親像展覽品、展覽活動來記錄。仝時間嘛有個人匯入法條、村里、學校、圖書館、戲齣節目的集等等 --- ## Community Meetup  ![OpenStreetMap x Wikidata](https://upload.wikimedia.org/wikipedia/commons/c/c5/WdOsm-semanticBridge.jpg) Note: 逐個月有 OpenStreetMap 佮 Wikidata 社群佇台北遮的 Mozspace --- ## OpenStreetMap Merits in TW  * Power Towers * Hiking Routes * Cemetery * Cross-linked other database: Wikidata、Wikipedia * Multilingual: Tâi-gír(Hokianese), Ha̍k-ka-fa, Formosan Austronesian languages, English Note: Compare to other commercial maps, OpenStreetMap have much higher coverage of power towers, hiking routes and also cemetery. And OpenStreetMap is a web map and could easily linked to other online projects like Wikidata and Wikipedia. The multilingual tagging scheme also people to add Taiwanese Hokkien or Hakka, Formosan Austronesian Languages, and international language like English or Japanese. --- ## Taiwan Case: Hiking purpose Rudy Map  ![](https://i.imgur.com/cWWpitq.jpg =620x) Note: Here is an example of using OpenStreetMap, Rudy Map is used by hiking community in Taiwan. --- ## Taiwan Power Towers and Substation  http://overpass-turbo.eu/s/kpv ![](https://i.imgur.com/14dvGkO.png =320x) Note: I have mentened that we have quite a high coverage of power towers, and also substations. --- ## Connection between OSM and Wikidata  * link to each other * OSM secendary Wikidata link * Village, School dataset cleanse Note: For Wikidata, we have worked on art space dataset, river code dataset, village dataset, Taiwan government publications number, and Hakka theme data --- ## Wikidata Tags on OpenStreetMap  * [wikidata](https://wiki.openstreetmap.org/wiki/Wikidata)=* * Eg: [Taiwan](https://www.openstreetmap.org/relation/449220) (r449220, wikidata=Q865) Note: Q707456 是台北大學佇 Wikidata 的編號 --- ## Wikidata Secondary tags on OpenStreetMap  ![](https://i.imgur.com/Myfedyj.png =620x) Note: OpenStreetMap 遮的 Wikidata 次級標籤列表 --- ## [subject:wikidata](https://wiki.openstreetmap.org/wiki/Key:subject:wikidata)=Q16574  <div style="display:inline-flex;align-items:left;"> <div left> ![](https://i.imgur.com/wHu0cVj.jpg) </div> <div style="font-size:70%;display:flex;background-color:rgb(127 195 140/0.5);padding:1px;justify-content:flex-end;"> <div style="flex-direction:column; text-align:left">   * subject=Chiang Kai-shek (蔣中正) * OSM -> https://www.openstreetmap.org/node/2700264358 </div> </div> </div> Note: 蔣介石相關的記念物，道路、銅像(tâng-siōng)、各級學校的中正、介壽開頭的 --- ## [brand:wikidata](https://wiki.openstreetmap.org/wiki/Key:brand:wikidata)=Q4642867  <div style="display:inline-flex;align-items:left;"> <div left> [![](https://i.imgur.com/N8nJK6h.jpg =600x)](https://commons.wikimedia.org/wiki/File:7-Eleven_Pingxi_Store_20190908.jpg) </div> <div style="font-size:70%;display:flex;background-color:rgb(127 195 140/0.5);padding:1px;justify-content:flex-end;"> <div style="flex-direction:column; text-align:left">   * [operator:wikidata](https://wiki.openstreetmap.org/wiki/Key:operator:wikidata)=Q4642867 * operator=7-Eleven </div> </div> </div> Note: 連鎖商家的部份，會當用 brand:wikidata --- ## Etymology - Chiang Kai-shek related objects  * [name:etymology](https://wiki.openstreetmap.org/wiki/Key:name:etymology)=蔣中正 * [name:etymology:wikidata](https://wiki.openstreetmap.org/wiki/Key:name:etymology:wikidata)=Q16574 * [name:etymology:wikipedia](https://wiki.openstreetmap.org/wiki/Key:name:etymology:wikipedia)=zh:蔣中正 Note: 名號來源，嘛會當透過 Wikidata 加添各地頭的中正路佮蔣介石的關係 --- ## Road name after [CKS(Zhongzheng Road)](https://en.wikipedia.org/wiki/Chiang_Kai-shek) on OSM  * http://overpass-turbo.eu/s/jby ![](https://i.imgur.com/28Qm35t.png) Note: Chai-kai Shek is one the dictator and former president in Taiwan. We can use OpenStreetMap to analysis road named after him. --- ## Wikidata OpenStreetMap Property  * OpenStreetMap Way ID：[P10689](https://www.wikidata.org/wiki/Property:P10689) * OpenStreetMap Relation ID：[P402](https://www.wikidata.org/wiki/Property:P402) * OpenStreetMap node ID：[P11693](https://www.wikidata.org/wiki/Property:P11693) --- ## Villages in Taiwan  * inspired by serv [Barangay](https://en.wikipedia.org/wiki/Barangay) mapping projects, I want to told Taiwan story of mapping villages * total number is 7,748 * mapped by community members in 4 years * linked with government ID and Wikidata Note: Inspired by Serv, also known as Eugene, have started mapping Barangay in the Phillipines. I want to told Taiwan story of villages mapping. The OpenStreetMap Taiwan community took fours years to map every villages in Taiwan. The total number of villages is 7,749(date: 2022 7/1). And all villages are linked with government ID and Wikidata items --- ## Visualization of Villages in Taiwan  [![](https://i.imgur.com/fs9Ds83.png)](https://overpass-turbo.eu/s/1kR3) Note: Here is the visualization of the whole near 8 thousand villages of Taiwan. --- ## The history of create Taiwan Villages' data on Wikidata  * Start at 2019 * The fundemental geograph unit * Using Taiwan Government Datasets * New Porperty [Household Register System ID - P5020](https://www.wikidata.org/wiki/Property:P5020) Note: 臺灣遮的村里資料是對2019年開始，村里是臺灣上基本的政治地理單位(忽略鄰一个通常無GSI範圍的單位)。是根據政府的開放資料來建立，嘛順紲共戶役政代碼提案屬性 P5020 --- ## Monitor new or dissolve village in TW  Tool links：[https://wikidata.planetoid.info/?q=已建立鄉鎮條目](https://wikidata.planetoid.info/?q=%已建立鄉鎮條目) ![](https://i.imgur.com/rAxjSeN.png) Note: The community have set up a tools to monitor government dataset, if there is new entries or remove entries, we could make correspond edit on both Wikidata and OpenStreetMap. --- ## The Challenge of Up-to-date Village list  * Currently static mode, small mirror edit needs * Keep track of government dataset * Communtiy hurry to add stuffs * Much easier to add on Wikidata * Have to Wait for date of the new villages established, then create new villages relation on OSM Note: It is quite a hard work to keep both OpenStreetMap and Wikidata up-to-date to the newest government dataset. You have to add the new villages in time, and label the revoked villages in time. It is much easier to edit Villages on Wikidata due to you don't have to edit on the effect date. But for OpenStreetMap, you have to change the villages after the effect date. --- ## Wikidata river related property  * [P885: Origin](https://www.wikidata.org/wiki/Property:P885) * [P403: Mouth](https://www.wikidata.org/wiki/Property:P403) * [P974: Tributary](https://www.wikidata.org/wiki/Property:P974) * [P625: Coordinate](https://www.wikidata.org/wiki/Property:P625) * [P4614: drainage basin](https://www.wikidata.org/wiki/Property:P4614) * [P205: Basin country](https://www.wikidata.org/wiki/Property:P205) * [P402: OpenStreetMap Relation ID](https://www.wikidata.org/wiki/Property:P402) Note: 發源地、注入水體、支流、經緯度、集水區、集水區國家、開放街圖關係編號 --- ## Ceb Wiki - ljsbot  [![](https://i.imgur.com/ZU69q1R.png)](https://www.vice.com/en/article/4agamm/the-worlds-second-largest-wikipedia-is-written-almost-entirely-by-one-bot) Note: Cebunese Wikipedia 用機器人衝數量，無啥活人，通世界知 --- ## A typical Ceb-imported Item  [![](https://i.imgur.com/YkdaI3j.png)](https://www.wikidata.org/wiki/Q32208306) --- ## Tamsui River and its Branches  ![JOSM River Relation](https://i.imgur.com/L3o35Z9.png) Note: OpenStreetMap 頂懸整個淡水河流域的主流、支流的視覺化 --- ## List of Rivers  [![](https://i.imgur.com/InLoWvp.png =x550)](https://overpass-turbo.eu/s/1kR6) Note: By using Overpass Turbo, we could easily get a list of rivers in Taiwan, with government river code and Wikidata reference number --- ## Rivers' Challenge  * Small creeks have little documents * Adding [OpenStreetMap relations](https://wiki.openstreetmap.org/wiki/Relation) are not easy * Rivers with government ID are just Small portation * [Cebuano Wikipedia](https://en.wikipedia.org/wiki/Cebuano_Wikipedia) bot created articles chaos Note: Now it is the second part: the river story. We have to admit, editing OpenStreetMap relation is a hard job, not easy for new-comers. Sometimes we have to survey to get rivers' data. --- ## [Name Suggestion Index](https://wiki.openstreetmap.org/wiki/Name_Suggestion_Index)  * A side project belongs to iD, starting at October, 2013, with little attention * An independent project in 2019: [State of the Map US 2019](https://2019.stateofthemap.us/program/sat/mapping-brands-with-the-name-suggestion-index.html) Announcement Note: Name Suggestion Index 是 2013 年 10 月開始的，附屬 OpenStreetMap 編輯器 iD 經營的，2019 年獨立出來。頭起先 NSI 是無人顧的 side project --- ## [Name Suggestion Index](https://wiki.openstreetmap.org/wiki/Name_Suggestion_Index)  * language-independent, using Wikidata for mapping * made OSM object unification tagging under the same brand Note: NSI 希望會當解決迒語言的問題，用 Wikidata 來做精確對應。向望編輯遮會當靠 NSI 予連鎖商家標示統一 --- ## Common Taiwanese Brand  ![](https://i.imgur.com/oA8GOwf.png) Note: 臺灣人日常的消費的店家有真濟有加添入去 --- ## Banks in Taiwan  ![](https://i.imgur.com/AqkUfMq.png) Note: 親像所有的銀行攏有加添入去矣，配合 OpenStreetMap 遮匯入的銀行據點，相對是較完整的 --- ## [Bank of Taiwan](https://en.wikipedia.org/wiki/Bank_of_Taiwan) - NSI counts: 175  [![](https://i.imgur.com/qUaBSbH.png)](https://overpass-turbo.eu/s/1naT) Note: 因為時間關係，只有查全臺灣的臺灣銀行，照 NSI 的有 175 个 --- `osmium tags-count taiwan-20231112.osm.pbf 'brand:wikidata=*' -o OSM-2023-11/brand.txt` --- ## Summary of NSI - brand:wikidata Static  | numbers | Wikidata QID | catagory | name | | -------- | -------- | -------- |-----| | 5,259 | Q259340| convenience store | 7-Eleven| | 2,699 | Q10891564 | convenience store | FamilyMart | 2,401 | Q4375439 | parcel locker | iBox | 2,166 | Q20687952 | public bicycle | YouBike | | 899 | Q11326216 | convenience store | Hi-Life | | 785 | Q7262792 | supermarket | PX Mart | | 754 | Q698024 | fuel | CPC Fuel | | 694 | Q28417381 | fast food | Eightways | | 493 | Q10851968 | convenience store | OKMart | Note: --- ### School Data Features  * metadata: [school code](https://www.wikidata.org/wiki/Property:P7121), address, multilingual names * Link to Wikipedia, Wikidata, Wiki Commons * School Geometry on OSM * [Coordinate](https://www.wikidata.org/wiki/Property:P625) on Wikidata * OpenStreetMap school with Wikidata: [2,489](https://overpass-turbo.eu/s/1Dtu) Note: 學校有完整收佇 Wikidata，metadata 的資料有學校代碼、地址、各種語言名號。空間的部份是會當連結 OpenStreetMap，Wikidata 本身嘛會當收經維度 --- ## The most up-to-date School on OSM - [Overpass Query](https://overpass-turbo.eu/s/1Dtt)  ![](https://i.imgur.com/189UnMU.png =x400) Note: School visualization on OpenStreetMap --- ## School grades on OpenStreetMap  * need to add grades to match data between OSM and Wikidata * mass edit according to names: * elementary school: 1-6 * junior high: 7-9 * senior high: 10-12 --- ## Elementary school on Wikidata in Taiwan  ![](https://i.imgur.com/v52wwKk.png) Note: Wikidata Query service results --- ## [Wikiproject Taiwan/Schools](https://www.wikidata.org/wiki/Wikidata:WikiProject_Taiwan/Schools)  ![圖片](https://hackmd.io/_uploads/HyRY5vEET.png) Note: Tagging scheme for Taiwan school --- ## School Data Summary  * Not up-to-date - imported most in 2019 * Announcement of New Schools esablished * Duplicated items imported from Japanese Wikipedia * Items with Wikidata tag: 2,489 Note: 對 2019 年了後，無啥更新。Wikidata 遐有新設立的學校，是看著新聞去加的，抑是有人佇 OpenStreetMap 加添。除了更新資料以外，另外有日語維基遐重疊，毋過無偌濟。 --- ## Challenges for all kind of Data  * Update village data to keep up to date to government village dataset (help from Plantoid's tools) * add more river relations * Fundemental platform, hard working not easy to catch the spotlight * Multilingual * Need contribution~~fundraising~~、~~human resource~~ Note: There are some added or removed villages by Taiwan government in 2022, so OpenStreetMap and Wikidata Taiwan community have to change corresponded OSM relations and Wikidata items. The big rivers' tribunties are added one by one by creating waterway relations for the creeks. The data quality is a big problem. OpenStreetMap and Wikidata are quite fundemental platform in most people view. And the multilingual part need people who speak the language to help. Need people, need funding! --- ## Future Plan - Action  * Theme workshops * Mapping OpenStreetMap river relation to Wikidata items * Adding multilingual labels on Wikidata river items, including Taiwanese Hokkian, Taiwanese Hakka, [Formosan Languages](https://en.wikipedia.org/wiki/Formosan_languages) names Note: Even during the COVID-19 pandamic, we still want to hold theme workshop to teach new-comer how to edit OpenStreetMap. And finally to edit rivers, and link to other database like Wikidata. Taiwan have a new law to preserve National languages including Taiwanese Hokkien, Taiwanese Hakka, Formosan languages. And we want to add these National Languages to both OpenStreetMap and Wikidata. --- ## [To-siā!](https://en.wiktionary.org/wiki/%E5%A4%9A%E8%AC%9D#Chinese) [sṳ̀n-mùng-ǹ!](https://en.wiktionary.org/wiki/%E6%89%BF%E8%92%99%E4%BD%A0) Thank you! :sheep:  - [GitHub](https://github.com/Supaplextw/) - Supaplex: [Wikidata](https://wikidata.org/wiki/User:Supaplex)，[OpenStreetMap](https://www.openstreetmap.org/user/Supaplex) - Or [email](mailto:dennis@wikimedia.tw) - Facebook group [Wikidata Taiwan](https://www.facebook.com/groups/2212207218990971/)、[OpenStreetMap Taiwan](https://www.facebook.com/groups/OpenStreetMap.TW/) Note: Here is my contact information, To-siā, sṳ̀n-mùng-ǹ! Thank you!