-
Getting scraped parlamento.pt data into google spreadsheet
In this opendata project we’re trying to make it easy for non-techie folks to collaborate and contribute to, and since spreadsheets are still the best way for them to get an idea of what data we already have and do some experiments with them (charts and other visualizations) I decided I should try to connect…
-
a ver a rua
pelas ruas do porto…
-
Tools and Libs for Scraping parlamento.pt
So what am I using to scrap the parlamento.pt site? Well, first let me tell you that i’m mostly a Microsoft Developer. I develop web applications with Visual Basic and (less) C# (using Visual Studio) and also MS SQLServer but I’ve also played and did a few projects with PHP and MySQL. Since the Hacklaviva…
-
Scraping parlamento.pt
Because scraping is the boring part of exploring data I tried to find the easiest, less time-consuming, yet easy to maintain set of tools to do it. Since the URLs are (somewhat) well known, I was able to skip the crawler, url discovery part of this projects, I just curl(ed) the page that I wanted…
-
parque oriental 2010
pelas ruas do porto…
-
Portuguese Opendata Projects
One of my “low-intensity” projects is the exploration of portuguese open-data, mostly governmental data. I’ve written some things about it (in portuguese) and also developed some (very few) applications but have never done anything really interesting, mostly because of the lack of time. Fortunately this year I came across a some interesting folks who also share…
-
stcp
pelas ruas do porto…
-
auto-retrato
pelas ruas do porto…
-
Scrapers, Repositórios e APIs
Um boneco para me ajudar a perceber o que temos feito no Projecto Transparência 1. há um conjunto de sites onde vamos querer ir retirar informação 2. esse processo é feito criando programas que fazem o scrap dessa informação 3. essa informação é gravada em repositórios de desenvolvimento. os repositorios de desenvolvimento seriam aqueles sobre…
-
Catarina Cadima / Luis Guimarães – II Congresso de Arquitectura Sustentável (apontamentos)
Notas sobre a apresentação de Catarina Cadima / Luis Guimarães na 3ª sessão do II Congresso de Arquitectura Sustentável. (ver pdf) projecto ecovia proposta integrada de um corredor verde de mos não motorizados e canal bus com forte incidência nos movimentos pendulares problemas emergentes da desertificação urbana 1986 – dgpd => mobilidade e uso de…