Jack_Chou

@KingJack

NTU GEO -> IM

Joined on May 11, 2021

  • Setup Environment Create virtual environment python -m pip install virtualenv python -m virtualenv env # activate virtual environment source env/bin/activate Install dependencies pip install -r requirements.txt python set_up.py install
     Like  Bookmark
  • IAM -- Identity and Access Management What's IAM? IAM allows you to manage users and their level of access to the AWS console. IAM offers: Centrallised control of your AWS account Shared Acccess to your AWS account Granular Permissions Identity Federation
     Like 2 Bookmark
  • Personal Information Account Item Table Column Name Email f_user femail
     Like  Bookmark
  • Balance_audit Scenarios Deposit Withdraw Convert Send to Received from Content
     Like  Bookmark
  • tags: 臺大宿網 環境與設備 地點:臺大男二舍 路由器:D-link DIR-1210 註冊MAC (Media Access Control Address) 使用乙太網路(有線)將電腦連接至宿舍網路孔 關閉WIFI
     Like  Bookmark
  • You are a consultant planning to deploy DynamoDB across three AZs. Your lead DBA is concerned about data consistency. Which of the following do you advise the lead DBA to do? :::spoiler Answer To ask the development team to code for strongly consistent reads. As the consultant, you will advise the CTO it may have higher latency than eventually consistent reads. When you request a strongly consistent read, DynamoDB returns a response with the most up-to-date data, reflecting the updates from all prior write operations that were successful. However, this consistency comes with some disadvantages such as read might not be available if there is a network delay or outage, higher latency than eventually consistent reads, global secondary indexes not supported, and use of more throughput capacity than eventually consistent reads. ::: By definition, a public subnet within a VPC is one that
     Like  Bookmark
  • 問題描述 爬取電商網站的商品照片資料時,明明在該網站上看就是正常的 但是把爬下來的照片網址複製貼上,卻發現照片又小又糊。 圖左為爬下來的圖片網址 圖右為利用開發者工具檢視該網站HTML取出的照片網址 分析原因 如果仔細去觀察網站,會發現當快速滑動頁面的時候,照片會先是模糊的才慢慢變清楚 這時候我們就可以推測該電商使用Lazy Loading的技術 讓該商品資訊進入螢幕的時候才進行加載,所以我們一開始抓到的資料才會是模糊的。
     Like  Bookmark
  • Situation When operate crawler with selenium, it may occur the following error: selenium.common.exceptions.SessionNotCreatedException: This version of ChromeDriver only supports Chrome version 91 Current browser version is 93.0.4577.63 with binary path /usr/bin/google-chrome It means you have to update your ChromeDriver to fit your bowser version. Solution
     Like  Bookmark