Dan Mathieson
Live Demos

Thoughtful AI: Lead Technical Product Manager

November, 2024 - September, 2025

Lead Technical Product Manager

My success as a Customer Engineer created an unexpected challenge for Thoughtful's leadership: how to scale the role as the company grew. Despite extensive recruiting efforts to "find more people like Danny," leadership realized the combination of deep technical knowledge, customer relationship management, and healthcare domain expertise was exceptionally rare in a single person.

This realization prompted a restructuring of the Customer Engineer role into three specialized positions: a Customer Success Analyst (customer-facing, ROI roadmaps), a Technical Product Manager (automation design, customer consultation), and a Forward-Deployed Engineer (technical implementation). I transitioned to the TPM role as it sat at the intersection of technical expertise and customer understanding.

I quickly became the trusted technical advisor to both CSAs and the sales team, translating complex customer needs into viable technical solutions. I maintained a full delivery load through the transition, serving as the bridge between our evolving organizational structure and our expanding customer base.

Value Realization Modeling

One of the most impactful things I built at Thoughtful wasn't an automation. It was a framework for measuring what our automations were actually worth.

We lacked a coherent model for demonstrating ROI. I developed an end-to-end simulation of a customer's revenue cycle management process: from eligibility verification through denials management to payment posting. Using Python in Jupyter Notebook, I built a statistical model incorporating probability distributions for success and failure scenarios throughout the lifetime of patient encounters and claims.

The simulation projected automation impact with genuine accuracy, accounting for the complex interdependencies in healthcare billing. I then designed specialized Quicksight dashboards for each agent in our portfolio, showing time savings, error reduction, and denial prevention rates within the simulated environment. The most impactful piece was an executive dashboard that translated technical performance into business outcomes: cumulative staff hours saved, revenue protected through reduced denials.

This framework became the foundation for our sales team's value proposition conversations. Healthcare executives could see concrete projections of how our automation suite would impact their specific workflows and financial outcomes. It helped us close deals and retain customers who might otherwise have struggled to articulate the ROI internally.

Built with: Quicksight, Python, Google Sheets, AWS, Jupyter Notebook, statistical modeling

Leading Forward Deployed Engineers

The restructuring that created my TPM role also created the Forward Deployed Engineer function: the team members who owned the hands-on technical implementation work on customer deployments. As Lead TPM, I was the delivery lead those FDEs reported to and took direction from.

In practice, I was managing between one and three FDEs per project across a portfolio of three to six concurrent implementations at any given time, which put the upper bound at roughly eighteen active workstreams. My job was to assign work within each deployment, unblock engineers when they hit technical obstacles, and own the customer relationship from a technical perspective throughout. I was the one translating build progress into terms that meant something to the customer: accuracy milestones, timeline adjustments, scope decisions. When a build was working, I showed them the data. When something had gone wrong, I owned the conversation.

I reviewed code when necessary, which typically meant something had surfaced in a customer call or an accuracy metric had flagged a problem I needed to trace back to the implementation. My instinct was always to first check the data: pull the S3 logs, run a quick pipeline to surface where the failure mode was appearing, then hand that to the FDE with a clear enough picture of the problem that they could fix it without needing me in the weeds. Code review was the last step, not the first.

The customer relationship side of this was where I spent most of my time. Healthcare executives don't want engineers on calls unless something has gone wrong. What they want is someone who can tell them whether the automation is performing against the agreed-upon target, what the plan is if it isn't, and what the next milestone looks like. I built that communication layer as a consistent practice: Quicksight dashboards updated on a regular cadence, clear accuracy metrics by workflow category, and a habit of showing them data before they asked for it.

Taking Over the Team

After the restructuring, Thoughtful tried several leadership configurations for the three specialized teams. External managers came in and struggled. The fundamental problem was that leading these teams required understanding the intricate relationships between customer needs, healthcare domain knowledge, and our technical capabilities. That knowledge had been built organically over two years of being in the trenches. It couldn't be transferred in an onboarding.

As leadership challenges threatened our delivery momentum, the executive team asked me to step in as team lead during what was framed as a temporary transition. I accepted reluctantly. I'd intentionally avoided management earlier in my career to stay focused on technical development.

The interim role became permanent as I demonstrated I could maintain delivery quality while establishing processes that let our growing team scale. I strategically redistributed my project portfolio: keeping the most complex implementations for myself while delegating others to create bandwidth for leadership work. Balancing tactical execution with vision-setting while the company was scaling fast was genuinely hard. But stepping into the role was the right call, and it shaped my understanding of what technical leadership actually requires.

TPM Delivery Contribution

My time as a formal TPM was brief: roughly three months before I was promoted to lead the team. But the output from that window was significant. During the period I held the TPM role, my implementations accounted for approximately 63% of Thoughtful's net new ARR as the company grew 3x year-over-year. That ratio reflects something important about the role: the TPM function sat at the exact intersection where technical complexity and commercial outcome met. Getting an implementation to production and demonstrating ROI was what turned a customer into a reference and a reference into the next logo.

Transformations Care Network was the clearest example from that window. TCN is a behavioral health provider operating across five states, backed by Shore Capital Partners, with active expansion into additional states driven by Shore Capital's growth mandate. They came to Thoughtful because their staff couldn't keep pace with eligibility and benefits verification volume as the expansion accelerated. I was the solo lead on the build start-to-finish, including writing portions of the agent code myself: an eligibility verification agent that was covering 80–90% of their benefits checks by go-live. It was one of the few implementations we delivered profitably end-to-end.

The Shore Capital relationship extended beyond the project itself. We structured referral credits into the contract: TCN was incentivized to introduce us to other Shore Capital portfolio companies if they could vouch for the delivery. By the time the TCN build wrapped, we were in late-stage discussions with several other Shore Capital holdings as a direct result. That was a different kind of sales motion — not a single company evaluating a product, but a PE firm developing a pattern of adoption across a portfolio. TCN was also my first implementation I owned entirely on my own, which made it formative in a way the later, larger deals weren't.

The reason I got promoted so quickly wasn't just delivery volume. It was that I was doing something harder than implementation. I was making judgment calls about what to build, in what order, at what fidelity, against what constraints. Those are product decisions. The Lead TPM role formalized what I was already doing informally: setting the direction, not just executing it.

Determinism as a Design Principle

One of the most important things I learned building AI automations in healthcare was when not to use non-deterministic AI. Healthcare billing workflows have near-zero tolerance for probabilistic outputs. A wrong eligibility determination means a denied claim, a wrong payment posting means a compliance problem, and a wrong denial routing means lost revenue. Customers didn't care about our model's average accuracy; they cared that every output was correct.

My design philosophy evolved into a consistent pattern: use AI where it genuinely adds value (pattern matching across variable inputs, extracting structure from unstructured text, handling edge cases that can't be enumerated in advance), and everywhere else, write code. A deterministic Python function is always more reliable than an LLM producing the same output. The hybrid-RAG architecture I built at Thoughtful was an explicit implementation of this: the system converged toward determinism over time. The human-verified outputs from each cycle became hard-coded answers for future identical inputs, shrinking the space that required live inference. Eventually, most cases were handled without touching the LLM at all.

I extended this to how I wrote MAPs. Rather than designing workflows that depended on the agent "figuring it out," I specified explicit decision trees wherever possible. The agent became the executor of deterministic logic, not the reasoner making uncertain judgments. Pairing LLMs with engineers writing deterministic execution paths, rather than hoping the LLM handles it, is what let our agents achieve accuracy levels an order of magnitude above the human baseline.

EOB Parsing and Eval Engineering

Before my promotion, I was assigned to an Explanation of Benefits (EOB) parsing project: automating the extraction of structured payment data from PDF EOBs sent by payers. EOBs are genuinely hard to parse. Format varies by payer, layout changes across plan years, and the data structures are inconsistently placed across the document. I built evaluation infrastructure for the parsing agents: a labeled dataset of EOB samples across payer formats, scoring logic that measured field-level extraction accuracy, and regression tests that flagged when a model or prompt change degraded performance on previously passing cases.

I was pulled off the project mid-stream when the Lead TPM opportunity arose. The eval framework I'd built remained in use by the team that continued the work.

Pre-Sales Technical Authority

The analytics work I did at Thoughtful had an unexpected second life. The Quicksight dashboards I built for customer observability, the value realization model I developed, and the canonical template I created for agent performance reporting all became artifacts our sales team wanted to show prospects before deals closed. What started as tools for existing customers turned into the primary way our GTM team illustrated what made our agent platform different from generic RPA.

Our CEO and CPO started pulling me into large sales opportunities to help explain what we were building and how it solved the specific workflows a prospect was struggling with. The skill was the same one I had been developing for existing customers: listening carefully enough to understand the real problem, then connecting our technology to it in terms that made sense to the person I was talking to. It worked. Within a few weeks, I was on every sales opportunity in the pipeline.

The number that stuck: 96% of prospects who met with me moved to proposal stage within a month. Sales started breaking scheduling rules to get me on calls that were stalling. "Just put Danny on a call, prospects love him" became a standing instruction. I was running a full delivery load simultaneously, which made the output from that window unusual even by Thoughtful standards.

This also had a direct technical benefit beyond funnel metrics. My involvement in pre-sales created better scoping for custom agent engagements before a contract was signed. The deeper my understanding of a prospect's actual workflow, the tighter the initial technical specification. That reduced the ambiguity that historically caused implementation timelines to slip. Pre-sales was functioning as early requirements engineering.

When the Smarter Technologies merger formed and the sales organization was scaling rapidly, leadership had a frank conversation about messaging with prospects. The sales team had a simple answer: "Can we just have Danny full-time?" I was promoted to Director of Sales Engineering the next day.

The Merger and What Came Next

In September 2025, Thoughtful AI underwent a private equity merger during our Series B fundraising process. We combined with three other companies to form Smarter Technologies.

For me it was a natural transition point. After two years building deep RCM expertise, customer-facing credibility, and leadership experience across three roles, I stepped into the newly created Director of Sales Engineering position at the combined company. Everything I'd learned at Thoughtful (the healthcare RCM knowledge, the customer instincts, the systems thinking, the leadership lessons from both the successes and the crises) became the foundation for what I built next.