sparkql ✨: Apache Spark SQL DataFrame schema management for sensible humans [2020-ongoing]
A lightweight Python library that provides literate schema management for PySpark (Apache Spark). Designed for developers who regularly work with PySpark’s SQL DataFrames, part of Spark’s module for structured data processing. From personal experience, PySpark’s native support for schema definition can become hard to read and manage in real-world projects. sparkql provides an ergonomic interface to DataFrame schema management.
[
github ]
Patients, Please [2016]
A multi-platform open source game to highlight the stress and emotional toll of a clinician in an emergency ward, inspired by the indie game ‘Papers, Please’. Built at the Cardiff NHS Hackathon, January 2016. Winner of the ‘Patient Involvement Award’.
LASAGNE Multilayer Network Translation Framework (LMTF) [2014-2015]
Open source webapp for translation of multilayer network datasets. Work in conjunction with the EU-funded
LASAGNE research project.
[
Slides ]
Health Explorer Wales [2015]
Web app for the visualisation of health and wellbeing across Wales. Based on multi-variate geographic health information, combined from multiple open data sources. Built at the Cardiff NHS Hackathon, February 2015.
[
App ] [
Source ] [
Blog Post ]
Target Tracking Quadrocopter [2013-2014]
Programming a Parrot AR.Drone to follow a target. Used for demos and outreach at the
Cardiff University School of Computer Science & Informatics. Tech: JavaDrone; Parrot AR.Drone V1; JavaCV.
[
Blog Post ]
Motion Kitty Pi [2012]
Motion-sensitive Spotify music streaming on a Raspberry Pi. Developed at the Cardiff “Open Sauce” Hackathon, March 2012. Winner of the ‘Individual Prize for Best Hacker’. Tech: LibSpotify; Django; Django-Piston.
Gritly [2011]
Maps mashup displaying winter weather road hazards in the UK. Combined static UK Road Safety Data with crowdsourced weather warnings. Developed at Box UK’s “For The Social Good” Hackday, November 2011. Winner of the ‘First-Place Team Award’. Tech: Django.
[
Blog Post ]
FourCrawl [2011]
Propose and schedule a pub crawl using Foursquare. Developed at the Foursquare “Global Hackathon” Cardiff, September 2011. Tech: Django.
Cardiff University “DigiSocial” Hackathon [2012]
Interdisciplinary research hackathon co-organised for PhD students in Computer Science, Social Science, and Mathematics. Held September 2012. Funded by a Cardiff Graduate Centre Interdisciplinary Initiative grant.
Foursquare “Global Hackathon” Cardiff [2011]
Two-day Hackathon co-organised as part of Foursquare’s international hackathon event. Held September 2011.
Research talks can be found here.
ML in Action: Software Engineering Meets Data Science
October 2018. Guest lecture to MSc Data Science students at the University of Exeter.
Technical Debt in Machine Learning Systems
April 2018. Guest lecture to MSc Data Science students at the University of Bath.
Mining Github and Meetup.com to Explore the UK’s Digital Tech Clusters
March 2016. At PyDiff – the Cardiff Python user group. [
Slides on SpeakerDeck ]
Sex, Bugs, and Mobile Phones
May 2015. Outreach talk given at the “Tackling Epidemics Face On” evening at Birmingham Pint of Science 2015. [
Slides on SpeakerDeck ]
LASAGNE Multilayer Network Translation Framework (LMTF)
November 2014. At the LASAGNE project meeting held at Queen Mary University of London. [
Slides on SpeakerDeck ]
Cheating at rock-paper-scissors – meta-programming in Python
February 2014. At the first
Django Weekend, an international Python/Django conference held in Cardiff. [
Slides on SpeakerDeck ]
A brief journey through Foursquare user check-ins in Cardiff
April 2011. At the FTS (Food, Talks, and Students) – a PhD student seminar series at the Cardiff School of Computer Science & Informatics. [
Slides on SpeakerDeck ]
Towards Ambidexterity
December 2010. At the Inaugural ComSc Ignite.Â
Ignite format. [
Slides on SpeakerDeck ]
An introduction to Python programming… in 30 minutes?!
January 2010. At the FTS (Food, Talks, and Students) – a PhD student seminar series at the Cardiff School of Computer Science & Informatics. [
Slides on SpeakerDeck ]
Social Networks and Anthropology: How Many Friends is Too Many?
February 2009. At the FTS (Food, Talks, and Students) – a PhD student seminar series at the Cardiff School of Computer Science & Informatics. [
Slides on SpeakerDeck ]