This report begins with providing background on what feature analysis is and how (and why) it should be used in the design and validation of performance assessments. The report continues with examples of how the process of feature analysis can be assisted using large language models (LLMs) that are tied to publicly available chat applications, such as ChatGPT. This report concludes with recommendations for how best to work with LLMs when conducting feature analysis, including a discussion of prompt engineering and chain of thought reasoning techniques.