You are viewing content from a past/completed QCon

Track: Future of Human Computer Interaction

Location: Seacliff ABC

Day of week: Wednesday

The fantastical future of diverse and prolific devices that influence our interactions with computers and one another is approaching even more quickly than experts may have predicted. We are entering a world where the new normal is multimodal interaction using various modern user interfaces. These interactions can vary between combinations of voice, visual, facial recognition, AR/VR, IOT, and often utilizing mobile devices at the same time. This track will concentrate on going deep into coding for the digital-physical convergence over the next few years.

Track Host: Courtney Hemphill

Partner & Tech Lead @CarbonFive

Courtney Hemphill is a Partner and Technical Lead at Carbon Five, a strategic digital product development firm. She has been developing software since 1999, first at an early stage e-commerce startup and eventually moving into consulting. In her role at Carbon Five, she has built ground up HIPAA-compliant, cloud-based platforms for health care companies, worked on a large server cluster analysis and forecasting platform, and supported enterprise executives transitioning from third-party solutions to skilled in-house continuous delivery teams. She is currently managing the Carbon Five NYC team and helping companies in insurance and finance develop cloud-native, test driven, continuous delivery software for data management, APIs, and new product creation.

Courtney mentors for TechStars, is an advisor to several startups, and organizes coding workshops for women. She also sits on the Golden Gate Board of NatureBridge, and is constantly finding random new corners of the world to rock climb.

10:35am - 11:25am

Multi-Modal Input Design for Magic Leap

As wearable spatial computing devices become more of a reality, new opportunities for interaction between humans and computers arise. Magic Leap embraces a wide range of inputs including hand and eye tracking, speech, a wireless 6DoF controller, and support for external peripherals. Learn what types of new input modalities are coming online and how they can be used and combined in different ways to surpass existing approaches in terms of throughput, discoverability, accessibility, and prediction with stories and examples from Magic Leap's Interaction Lab.

Colman Bryant, Mixed Reality Game and Product Designer @MagicLeap

11:50am - 12:40pm

Rethinking HCI with Neural Interfaces @CTRLlabsCo

Brain-computer interfaces, neuromuscular interfaces, and other biosensing techniques can eliminate the need for physical controllers. In the context of interaction design, “control” is the process of transforming intention in the mind into action taken in the world (or machine).  When freed from the familiar bonds of the keyboard, mouse, game controller, and touchscreen, we’re faced with a clean slate and an epic design challenge. What happens when we decouple the user interface from hand-held hardware? We'll discuss this and the emerging field of neural interaction design.

Adam Berenzweig, Director of R&D @CTRLlabsCo

1:40pm - 2:30pm

Engineering Dumb: Modern Mobile Thin Clients

As mobile developers, we often hardcode everything from layouts to machine learning right onto the device. While this approach works for many situations, there are times when you’re going to want your app to be a bit more flexible. What I’m going to show you is a top-level walk-through of how I built a complex feature at OkCupid and along the way demonstrate a few design patterns that you can employ in your own app to create remotely configurable layouts and behavior on-the-fly.

Brandon John-Freso, Senior Android Engineer @WeWork

2:55pm - 3:45pm

Open Source Robotics: Hands on with Gazebo and ROS 2

In large part, the recent advancements in robotics have been made possible by open source tools. Open Robotics, a nonprofit organization dedicated to the development, distribution, and adoption of open source software in robotics, supports two main projects — ROS (Robot Operating System) and Gazebo, a multirobot simulator — both of which are widely used by the global robotics community, including industry, academia, and hobbyists. 

ROS is a framework that lets you quickly set up the various parts of a robot and get them all to work together as a meaningful application. ROS does this by setting a common transport layer for all the software inside the robot, from sensors and actuators to decision making. Around the common transport layer, there are several tools built to help developers introspect and diagnose their robots with ease. Gazebo is a simulator that calculates rigid-body dynamics, generates all kinds of sensor data, and allows user interaction through both a programming API and a powerful graphical interface. Some of the uses for Gazebo include robotics competitions, continuous integration, prototyping, machine learning and education. 

In this talk, Louise will give an overview of ROS and Gazebo, the problems they've been solving so far and what's in the roadmap for the future. In the second half of the talk, a hands-on demo will walk through the creation of a robot in simulation and controlling and inspecting it using ROS 2, the next generation ROS.

Louise Poubel, Software Engineer @OpenRoboticsOrg

4:10pm - 5:00pm

Patterns and Practices in Voice Computing

Remember the days when companies had a siloed mobile department that was regarded as an afterthought? The early days of mobile were met with mixed results. But playbooks eventually emerged for how companies could leverage mobile to amplify their business. At Amazon Alexa, we are seeing similar trends emerge with multi-modal voice computing. Drawing from lessons learned with Alexa Skills across Entertainment and IoT, we will work backwards from the customer and share technical and organizational patterns throughout the end-to-end journey. These stories will hopefully inspire you to work voice computing into the fabric of your company.

Yow-Hann Lee, Principal Solutions Architect Alexa @Amazon

Proposed Tracks

  • Operationalizing Microservices: Design, Deliver, Operate

    What's the last mile for deploying your service? Learn techniques from the world's most innovative shops on managing and operating Microservices at scale.

  • Developer Experience: Level up your Engineering Effectiveness

    Improving the end to end developer experience - design, dev, test, deploy and operate/understand.

  • Architectures You've Always Wondered About

    Next-gen architectures from the most admired companies in software, such as Netflix, Google, Facebook, Twitter, & more

  • Machine Learning without a PhD

    AI/ML is more approachable than ever. Discover how deep learning and ML is being used in practice. Topics include: TensorFlow, TPUs, Keras, PyTorch & more. No PhD required.

  • Production Readiness: Building Resilient Systems

    Making systems resilient involves people and tech. Learn about strategies being used from chaos testing to distributed systems clustering.

  • Building Predictive Data Pipelines

    From personalized news feeds to engaging experiences that forecast demand: learn how innovators are building predictive systems in modern application development.

  • Modern Languages: The Right Language for the Job

    We're polyglot developers. Learn languages that excel at very specific tasks and remove undifferentiated heavy lifting at the language level.

  • Delivering on the Promise of Containers

    Runtime containers, libraries and services that power microservices.

  • Evolving Java & the JVM

    6 month cadence, cloud-native deployments, scale, Graal, Kotlin, and beyond. Learn how the role of Java and the JVM is evolving.

  • Trust, Safety & Security

    Privacy, confidentiality, safety and security: learning from the frontlines.

  • Beyond the Web: What’s Next for JavaScript

    JavaScript is the language of the web. Latest practices for JavaScript development in and out of the browser topics: react, serverless, npm, performance, & less traditional interfaces.

  • Modern Operating Systems

    Applied, practical & real-world deep-dive into industry adoption of OS, containers and virtualization, including Linux on.

  • Optimizing You: Human Skills for Individuals

    Better teams start with a better self. Learn practical skills for IC.

  • Modern CS in the Real World

    Thoughts pushing software forward, including consensus, CRDT's, formal methods & probabilistic programming.

  • Human Systems: Hacking the Org

    Power of leadership, Engineering Metrics and strategies for shaping the org for velocity.

  • Building High-Performing Teams

    Building, maintaining, and growing a team balanced for skills and aptitudes. Constraint theory, systems thinking, lean, hiring/firing and performance improvement

  • Software Defined Infrastructure: Kubernetes, Service Meshes & Beyond

    Deploying, scaling and managing your services is undifferentiated heavy lifting. Hear stories, learn techniques and dive deep into what it means to code your infrastructure.

  • Practices of DevOps & Lean Thinking

    Practical approaches using DevOps and a lean approach to delivering software.