AI大语言模型在自动化用例生成中的探索
乙醇 创建于 6 months 之前
最后更新: 6 months 之前
阅读数: 721
最近读到这篇文章,原文在是https://drlee.io/implementing-ai-in-software-testing-creating-a-text-generation-model-for-test-automation-7294b26f93c4,里面涉及到一些基于ai进行自动化测试的探索,原文是这么说的:
将人工智能 (AI) 纳入软件测试可谓是游戏规则的改变者,能够显著提升效率和有效性。本文利用 OpenAI 的文本生成模型——尤其是 GPT-3.5-turbo 和 GPT-4-turbo-preview——在 Google Colab 中构建了一个文本生成模型,重点关注测试自动化用例。
看了一下,里面列举了3个测试用例。
The system shall allow users to securely login with a username and password.
这是用户登录的用例。
Ensure that the shopping cart allows users to add items, remove items, and proceed to checkout.
这是购物车的用例。
The weather API should return a JSON response with fields for temperature, humidity, and precipitation forecast for the next 5 days.
这是用生成基于json返回值的天气api的用例。
下面是ai生成的购物车用例,看起来还是比较完备的。
Regression Test Scenarios for Shopping Cart Feature:
1. Test Case: Adding items to the shopping cart
- Verify that the user can add a single item to the shopping cart.
- Verify that the user can add multiple items to the shopping cart.
- Verify that the quantity of the added items is correctly displayed in the shopping cart.
- Verify that the total price of the added items is correctly calculated and updated in the shopping cart.
- Verify that the user is able to add items with different variations (e.g., size, color).
2. Test Case: Removing items from the shopping cart
- Verify that the user can remove a single item from the shopping cart.
- Verify that the user can remove multiple items from the shopping cart.
- Verify that the quantity and total price of the removed items are correctly updated in the shopping cart.
- Verify that the user is able to remove items with different variations.
3. Test Case: Proceeding to checkout
- Verify that the user can proceed to the checkout page from the shopping cart.
- Verify that the user is redirected to the correct checkout page.
- Verify that the items in the shopping cart are correctly displayed in the checkout page.
- Verify that the total price of the items in the shopping cart is correctly displayed in the checkout page.
- Verify that the user is able to navigate back to the shopping cart from the checkout page.
后面的工作就是人工介入查缺补漏,然后导入用例管理工具。
本身代码也很简单。
def generate_test_cases(requirement):
response = client.chat.completions.create(
model="gpt-3.5-turbo",
messages=[
{"role": "system", "content": "You are a helpful assistant capable of generating software test cases."},
{"role": "user", "content": requirement}
]
)
return response.choices[0].message.content
feature_description = "Ensure that the shopping cart allows users to add items, remove items, and proceed to checkout."
regression_tests = generate_regression_tests(feature_description)
print(regression_tests)
总结
总的来看这篇文章的没什么太多新意,客观上讲目前ai直接生成的用例是不能直接使用的,需要进行一定的加工和优化,不过另一方面我们也必须注意到
- AI确实可以辅助我们进行测试用例的编写,有一定的提效效果
- AI的使用门槛确实很低,只需要几行代码就可以实现之前完全无法想象的功能
- AI生成的用例可能在教学演示中会有不错的应用,毕竟ai在短时间内创造材料的能力是人类所无法达到的