Author: Pili Hu

Technerpreneurstructor

Curate datasets for fun, and profit

Cover photo source: raul kalvo

The term “Curator” was traditionally used in the context of museums, library, gallery and art exhibitions. It general refers to the person who creatively plan and well organise resources to maximise the utility for the audience. The process that a curator gets the job done is thus “curate”.

TLDR readers, here are the sites that worth your visit:

Continue reading “Curate datasets for fun, and profit”

賣數據?賣能力?淺談數據新聞的商業出路 — 香港網絡媒體峯會後感

【編註】本文是2017年12月4日的香港網絡媒體峯會後的感想,由 Pili Hu 口述完成,先使用科大訊飛轉爲文字稿,再通過 OpenCC 由簡體轉爲繁體,經過輕量編輯後發出。因爲是口述稿,行文難免累贅,有部分用語不準確的地方,歡迎留言指正。從技術上看,是我們一次新的嘗試,希望藉此方法加速信息傳遞的效率。總共耗時爲1小時在地鐵上口述,加1.5小時編輯。

今天下午的網絡傳媒峯會。幾位主編都有分享,很多媒體運營的經驗。大家談論最多的話題還是媒體的商業模式。用端傳媒主編張潔平的話來說,媒體的商業模式主要有三種。第一種是廣告模式,即先用內容換取流量,然後再用流量去向廣告主收費。第二種模式是直接付費,即把內容直接賣給讀者,而最好的賣法是訂閱,相比點播,訂閱可以保證持續的現金流。第三種辦法,則是贊助,一些基金會或者個人金主,都會贊助大大小小的媒體。

香港網絡媒體高峯會2017@HKICC

Continue reading “賣數據?賣能力?淺談數據新聞的商業出路 — 香港網絡媒體峯會後感”

Learn Spreadsheet to Mine Data and Jumpstart Your Data Journalism Career – A Sharing by Aimee Edmondson

Aimee Edmondson is now an Associate Professor with Scripps School of Journalism, Ohio University. HKBU students are very lucky to have this knowledgeable and passionate speaker to talk about data journalism this afternoon. Her 12 years in reporting and later acquired statistics and technology are a fine combination for a data journalist. In the world where people are too fascinated by new technology and numerous boot camps are created by non-journalists, Aimee can be a role model for those “traditional journalists” who are moving in this direction.

Why does data matter? In Aimee’s words, you want to be a reporter, not a repeater. Data helps one to verify what the source is saying and find out what is really happening. To be pragmatic, we are seeing more and more JD requiring data analytics skills from investigative reporters. Going beyond the journalism domain, the skills trained by data journalism can well fit into corporate communication, public relation and advertising industry.

Picture: Job boards on IRE, from the slides

To start, one only needs to work on “small data”, with a spreadsheet.

Continue reading “Learn Spreadsheet to Mine Data and Jumpstart Your Data Journalism Career – A Sharing by Aimee Edmondson”

網絡數據包分析:從 Google Maps 獲取 Fusion Table 原始數據

網上經常見到使用 Google Maps 繪製的地圖,如果希望對地圖中的興趣點(Point of Interest,POI)進行二次分析,就需要得到繪製地圖背後的結構化數據。如果是使用 Google Fusion Table 繪製的地圖,可以通過網絡抓包找到 Fusion Table 的ID,進而拼接出原始地址。本文來自同學 Lam Man Kit 的投稿,僅做技術交流。數據記者在使用時,需要注意原始數據的版權。而本地的研究者也需要遵守公平使用原則。本文以 FactWire 的數據報道 「分析182個領展停車場月租收費 9成2貴過房委會同區 最大差距達1.18倍」 爲例。

圖:通過網絡抓包分析 Fusion Table 的 ID

Continue reading “網絡數據包分析:從 Google Maps 獲取 Fusion Table 原始數據”

Data News of the Week | e-waste in Hong Kong

Cover photo credit: Monitour Project

We have a special edition for DNW this week dedicated to e-waste in Hong Kong. The notes are derived from a seminar plus brainstorm session with researchers from CUHK, HKBU, PolyU, Lingnan U, activists from Land Justice, Open Data Hong Kong, CODE4HK. This is a quick note from memory, so evidence/ statistics/ figures quoted in this note need further verification before you use them. There are enough pointers for the reader to go back the source and find direct contacts.

The news points to follow

E-waste refers to the abandoned Electric and Electronic Equipments (EEE). With the booming of ICT industry, we are witnessing more and more e-waste these days. Why should you care? Let’s cut through the news points first:

  • 75% e-waste is disappeared, as Green Peace estimates. It collects data of EEE production and calculates expected e-waste according to the lifespans of devices. Comparing this with the e-waste collection data from formal government bodies, we can see a 75% gap, meaning those are lost track
  • 97.7% e-waste in Hong Kong goes to unknown channels (figure in 2009; may change due to new recycling plant; government is trying to increase supervised channels). This may signal a large number of illegal operation, but not necessary all illegal.
  • Hong Kong used to import a large volume of e-wastes given the loophole in the legislations. Those e-wastes went to mainland China for processing. The export to China was disrupted at 2015.
  • Yards/ factories/ workshops that collect, process and dump e-wastes exist in many remote locations in Hong Kong, especially New Territory. Those locations are not easily accessible, protected by “private lands” and “gangs”, as put by Land Justice investigators.
  • Many workers in those yards are illegal immigrants, for example from mainland and South East Asia. They usually work without proper protective measures.

Continue reading “Data News of the Week | e-waste in Hong Kong”

100 Year’s Earthquake around Sichuan in D3

Jiuzhaigou, a world-class scenic spot in Sichuan, China, suffered a drastic earthquake on 2017-08-08 21:19:46. People still remember the Wenchuan earthquake that caused thousands of deaths and loss of enormous properties. Does Sichuan have a lot of earthquakes in history? Which counties suffered most from the earthquakes? Pili Hu made this animated chart in D3 overnight for an overview of earthquakes happened in or around Sichuan region in the past 100 years. The data source is https://www.usgs.gov/. See the project in full page here: Sichuan Earthquake in 100 years.

近況|「端」數據

(This is a repost from “P话” http://bit.ly/1OiVjaa)

P話停更許久,很多朋友來關心過。感覺是時候報報近況。

那現在我在做什麼?——我是記者。在「端傳媒」。

說時髦一點,是「數據記者」。唬人一點,也可以自稱「數據科學家」,畢竟我還是有些許學術和技術背景。既然是「數據記者」,那我們做的自然就叫「數據新聞」了。什麼算數據新聞呢?回答這個問題,如同回答什麼是雲計算?什麼是物聯網?什麼是大數據?什麼是H5?……和任何一個新興行業一樣,buzzword的背後,有人在做乾貨,有人只是在玩弄商業詞藻。有人是興趣使然,有人只是職業憂慮——怕跟不上這一波潮流。所以,不如拋開定義,舉點例子。其實,我幾個月前寫的文章《40张图解Code for系列风潮》中,提到兩個案例即是。 Continue reading “近況|「端」數據”