Background Though many adults with ADHD underperform professionally, are more stressed, and have more days of sickness absence compared to adults without ADHD, few studies have explored the experience of working as an adult with ADHD. This study explores the general experience of working with ADHD, including stress and work-related mental illness. Methods Semi-structured telephone interviews were conducted with 20 working adults with ADHD. Interview topics included how the ADHD diagnosis and/or symptoms of ADHD may have affected participants on the job, how work may have affected participants’ well-being, and the need for support and accommodation. Qualitative content analysis was used to explore verbatim transcripts from the interviews. Results The analysis yielded three themes that describe some of the challenges of working with ADHD: Working and living with ADHD, Needs, and Special abilities, with a total of eight subcategories. Subcategories were Specific challenges; Relationships and cooperation; Negative consequences; Planning, prioritization, organization, and structure; Support, interventions, accommodations, and aids; Openness, understanding, and acceptance; Strategies; Strengths and qualities. Conclusion Further knowledge about the challenges of working with ADHD is needed in workplaces; where organizational support is lacking, much in terms of accommodations and aids is up to the employee, and the disclosure of diagnoses may be associated with great dilemma.