← All notes
CareerAI

Use Small Experiments to Find Your Next Tech Direction

A two-week direction sprint for turning uncertain career and project choices into evidence, learning, and a defensible next commitment.

You have three hours this week and several plausible directions. You could study agentic workflows, improve your SQL, learn a new data platform, build a portfolio project, contribute to an existing codebase, or prepare for a different role. All of them sound useful. None comes with enough evidence to deserve the next six months.

This is a decision problem, not a motivation problem.

When the route is uncertain, waiting for complete confidence usually produces more reading, more saved links, and more comparison. Committing blindly is not much better. It can turn discipline into a long investment in the wrong problem. A stronger approach is to make a small move designed to reveal something you do not yet know.

I use the term direction sprint for that move: a short, bounded piece of work that produces an artifact, exposes real friction, and ends with an explicit decision. Its purpose is not to transform your career in two weeks. Its purpose is to improve the quality of the next commitment.

At the startWhat the sprint should produceDecision at the end
“Maybe AI evaluation is worth learning”A small test set, two evaluated versions, and recorded failure categoriesDeepen, repeat with a sharper test, or redirect
“Maybe I should move toward data engineering”One reproducible pipeline with checks, orchestration, and a documented tradeoffTake a deeper project or return to another path
“Maybe this team needs an AI assistant”A narrow workflow prototype tested by intended usersFund discovery, revise the problem, or stop

The table looks simple because the discipline is in the boundary. One uncertainty. One small artifact. One review date. One real choice afterward.

The market will not settle before you have to move

Technology career advice often assumes the environment will hold still long enough for a perfect map to appear. The present AI market makes that assumption especially weak.

In June 2026, Anthropic’s Economic Index report described a shift from ordinary chat toward longer-running agentic tasks in its own products. Its linked survey also found that early-career Claude users reported more concern about job loss, while frequent delegators were more optimistic about their skills and prospects. Anthropic is clear that this is not a representative workforce sample: technical and management occupations are heavily overrepresented. That limitation is part of the useful signal. Even among active users of the same technology, the work patterns and career interpretations are not uniform.

Research methods are moving too. METR’s February 2026 developer productivity update explained why the organization could not make a strong estimate from its newer experiment. Some developers did not want to work without AI, participants selected tasks partly according to where they expected AI to help, and parallel agents made time tracking harder. METR changed the experimental design rather than presenting weak data as certainty.

You do not need to derive a career prediction from either report. Their more grounded implication is that tools, task selection, and the way work is measured are changing together. A static list of “future-proof skills” cannot resolve an individual decision. You need local evidence about what you can learn, what work you can tolerate, where you create value, and what the relevant people actually need.

This is why choosing career direction without chasing passion begins with useful interests and proof rather than a grand calling. A direction sprint begins one step later. It asks how to create proof before making a large bet.

Consistency should buy information

Consistency is often described as maintaining a streak: write every day, code every day, study every morning. A streak can help when the task is already well chosen. Under uncertainty, repetition needs a stricter test.

Every session should purchase at least one of four things:

  • Capability evidence: you can now perform a task you could not perform before.
  • Problem evidence: the need is real, specific, and worth further effort.
  • Fit evidence: you want to stay with the difficult parts after the novelty fades.
  • Constraint evidence: you found the missing prerequisite, access, feedback, or time that blocks progress.

Constraint evidence can feel negative, but it is valuable. Discovering that an analytics assistant depends on metric definitions your organization does not have is progress. Discovering that you enjoy model demos but dislike the evaluation and operations work is useful career information. Discovering that a new framework adds complexity without improving the workflow can save months.

The cadence fails when it produces only exposure: more videos watched, more tools installed, more generated code accepted, more repositories started. Exposure can support a sprint, but it cannot be the final output. The work must leave behind something that another person—or your future self—can inspect.

In my teaching, I repeatedly see learners discover their real gaps when they try to make a complete piece of work function without a step-by-step recipe. A familiar explanation can create confidence. A broken input, ambiguous requirement, failing test, or missing dependency reveals the skill boundary. That is not evidence that the learner should quit. It is the information needed to choose the next practice.

Start with a decision, not a subject

“Learn AI agents” is too broad for a useful experiment. So are “improve at Python,” “get into data,” and “become more employable.” A sprint needs a decision it can inform.

Write the decision in this form:

At the end of two weeks, I need enough evidence to decide whether to ___, ___, or ___.

For example:

At the end of two weeks, I need enough evidence to decide whether to deepen my work in AI evaluation, run a second test focused on retrieval, or return my limited learning time to data engineering.

Then name the uncertainty behind the decision. It might be:

  • Can I perform a realistic slice of this work, not just follow a demonstration?
  • Does this problem appear often enough to justify specialization?
  • Will intended users change their behavior when the artifact exists?
  • Does AI assistance improve the outcome after review costs and errors are counted?
  • Is my difficulty a normal skill gap, a missing prerequisite, or evidence of poor fit?

One sprint should not answer all five. Pick the uncertainty that would most change your next commitment.

This separates the method from just-in-time learning for AI and data careers. Just-in-time learning helps you choose the depth required by current work. A direction sprint helps you decide whether a line of work deserves that depth in the first place.

Run the two-week direction sprint

Two weeks is not a universal duration. It is long enough for the first enthusiasm to meet friction and short enough to protect you from a large sunk cost. A working professional might use six focused sessions rather than fourteen consecutive days. Preserve the sequence, not the calendar theater.

PhaseActionEvidence to retain
FrameDefine one decision, one uncertainty, a time budget, and a stop dateA one-paragraph sprint brief
BuildProduce the smallest complete artifact that can encounter realityWorking code, analysis, workflow, test, or decision memo
StressTest ordinary, edge, and failure cases; note where AI or documentation misleads youA friction log and a few reproducible failures
ExposePut the artifact in front of an intended user, practitioner, reviewer, or realistic testObservations, questions, corrections, and rejected assumptions
DecideCompare the evidence with rules chosen before the sprintDeepen, repeat, or redirect

Frame the boundary

Set a maximum number of hours. Name what you will not do. If the sprint is about evaluating a small retrieval system, do not add authentication, a polished interface, three agent frameworks, and cloud deployment. Those additions may be worthwhile later; during the sprint, they can hide whether you learned the thing you meant to test.

Define “complete” as a learning condition. A useful boundary might be: 25 questions labeled by expected evidence, two system versions compared, failures grouped into categories, and a one-page conclusion. Completion is not “master AI evaluation.”

Build a complete slice

A complete slice crosses the important parts of the work at small scale. For a data pipeline, ingest a real public dataset, validate a few fields, handle one failure, run the transformation reproducibly, and document the output. For an agent, use one or two tools, constrain permissions, log actions, add a step limit, and test malformed tool results. For an analytics project, begin with a decision someone could make, then trace the data and definitions required to support it.

The slice should be small enough to finish and complete enough to disconfirm your assumptions.

Keep a friction log

Do not turn the log into a diary. Record evidence with four fields:

EventCurrent diagnosisWhat you triedWhat the result changed
Retrieved sources were relevant, but answers mixed two policy versionsMetadata and freshness problemAdded version fields and a filterEvaluation work became more interesting than prompt tuning
AI-generated pipeline passed the happy path but failed on null timestampsVerification gapAdded schema and boundary testsNeed deeper practice in data contracts
Two intended users ignored the prototypeWorkflow may not matter enoughAsked how they solve the task nowProblem statement needs revision before more building

The “current diagnosis” wording matters. It prevents a first guess from becoming a permanent story. New evidence can replace it.

Expose the work

Private practice can reveal technical gaps. It cannot tell you whether your artifact is understandable, useful, or credible to other people.

Feedback does not require a large audience. Ask one practitioner to review the repository. Give one intended user a realistic task without coaching them through every click. Compare your analysis with a known result. Submit a small pull request. Explain the design to a peer who is allowed to challenge it.

Seek behavioral evidence before praise. “Looks interesting” is weak. A reviewer finding an invalid assumption, a user completing a task, or a test exposing a regression is stronger.

Let AI accelerate the test without faking the result

AI coding agents and assistants can compress a direction sprint. They can help locate documentation, scaffold a project, draft tests, explain an unfamiliar error, or offer alternative designs. Used well, that allows you to encounter deeper problems within the same time budget.

It also creates two traps.

The first is borrowed completion. The repository runs, but you cannot explain the architecture, reproduce the result, or judge whether the output is correct. The sprint has measured the tool’s ability to produce a plausible artifact, not your readiness for the work.

The second is inflated scope. Cheap generation encourages more features, more files, and larger changes. Review capacity does not expand at the same rate. DORA’s current guidance on working in small batches connects small, testable changes with faster feedback and warns that large AI-generated changes are hard to review and integrate safely. That principle applies to individual learning as well as software delivery.

Use three checks before counting AI-assisted work as evidence:

  1. Explain: Can you describe the choice, dependency, and failure in your own words?
  2. Verify: Can you run a test or inspection that could prove the output wrong?
  3. Modify: Can you change a requirement without asking the tool to rebuild everything?

These checks complement the five-gate framework in How to Turn Technical Learning Into Usable Skill. The goal is not unaided purity. Modern technical work includes AI assistance. The goal is to preserve enough understanding and verification that the artifact remains evidence of your judgment.

Choose measures that can change the decision

Many learning metrics are easy to count and hard to use: hours studied, prompts sent, lessons completed, lines of code, stars, or daily streaks. Keep them if they help manage effort, but do not confuse them with decision evidence.

Before starting, choose a few measures tied to your uncertainty:

  • If you are testing capability, count complete tasks, test outcomes, failure categories understood, or how much help remains necessary.
  • If you are testing problem value, observe frequency, user behavior, time lost today, error consequence, or willingness to review another version.
  • If you are testing fit, note whether curiosity survives debugging, documentation, cleanup, and explanation—not only whether the demo was enjoyable.
  • If you are testing career signal, ask whether a practitioner can inspect the artifact, question your choices, and see relevance to real work.

Avoid inventing precision. Two user conversations do not establish market demand. Twenty-five evaluation examples do not prove production reliability. A sprint produces directional evidence, not a universal conclusion.

The measure should be capable of disappointing you. If every possible result will be interpreted as “continue,” the sprint is a ritual, not an experiment.

Use stop rules to make consistency intelligent

Persistence is useful when each cycle teaches you something. It becomes expensive when the same approach keeps failing without a changed diagnosis.

Set stop rules before the work becomes part of your identity. Pause or redirect when:

  • the artifact cannot reach the decision-relevant condition within the time budget;
  • the problem disappears after one honest conversation with an intended user;
  • repeated sessions produce no new capability, feedback, or constraint evidence;
  • the required access, data, money, or mentorship is unavailable for the foreseeable future;
  • the work depends on risks you are not willing or authorized to take;
  • you are continuing mainly because stopping would make past effort feel wasted.

A stop can still produce a useful record: what you attempted, what blocked it, which assumption failed, and what would need to change before revisiting. That record prevents you from rediscovering the same dead end six months later.

Redirection is not inconsistency. If evidence changes the plan, changing the plan is the disciplined response.

End with one of three decisions

Every direction sprint should close with a short review and one of three outcomes.

Deepen when the problem is real, the difficult parts remain worth doing, and the next level of capability is clear. Commit to a larger project, structured study, mentoring, or applied responsibility. This is where sustained consistency becomes valuable because the direction now has evidence behind it.

Repeat when the signal is promising but the test was weak. Narrow the uncertainty rather than rerunning the same sprint. If a retrieval prototype worked on clean documents, the next test might examine conflicting versions and access controls. If an AI coding assistant felt faster, compare completed, reviewed changes on two recurring task types instead of relying on perception.

Redirect when the problem, fit, or conditions do not justify more investment. Carry forward any transferable asset: Python practice, evaluation habits, user interviews, data cleaning, documentation, or a clearer view of the work you do not want.

If repeated activity is no longer producing stronger capability or better options, use the broader diagnostic in Why Your Tech Career Stalls and How to Reset It. A direction sprint is designed for a bounded uncertainty. It cannot repair an environment that blocks learning, ownership, or recovery.

The next direction rarely becomes obvious all at once. It becomes more defensible as small pieces of work reveal the terrain: what breaks, what holds your attention, what other people value, and what skill the next version demands.

You do not need certainty before acting. You need an action small enough to survive being wrong and concrete enough to teach you something. Keep the cadence sustainable, keep the evidence honest, and let each completed experiment earn the next commitment.

More notes