THE
EVALUATION OF WEB-BASED AND ANDROID FACE-TO-FACE TUTORIAL APPLICATIONS QUALITY
USING THE USER ACCEPTANCE TESTING (UAT) METHOD
Erman arif1, Imelda Paulina Soko2
Information
System Study Program/Universitas Terbuka Tangerang Selatan, Indonesia1
Educational Technology Education Study
Program/Universitas Terbuka Tangerang Selatan, Indonesia2
e[email protected]1, [email protected]2
![]()
Received: 02-08-2022 ���������������� ��������������� Accepted:
10-08-2022 ������������������ ���Published: 20-08-2022����������������
ABSTRACT
Problems in the learning system at the Universitas
Terbuka Basically no only focus against the tutorial in network only, but also
on service help study stare advance that is not yet there is a system for monitor
to what extent are the activities of the Tutorial Gaze Face (TTM). Studies this
aim for measure how far is the quality Gaze Tutorial app Advance Web Based And Android.Methods used in
measure quality application is use User Acceptance Testing (UAT) method. of
several amount respondent could taken
conclusion how far is the quality applications that have been done made in form
prototype. After To do testing could taken conclusion that face tutorial app advance have
attractive appearance, easy menus understood, content or Theory easy understood
and understood, application this can also used as
media in tutorial activities
Keyword: help study, evaluation, software quality, UAT.
![]()
Corresponding Author: Erman arif
E-mail: e[email protected]
INTRODUCTION
Technology play role important to every field (Nur Fauzi et al., 2022). �With Keep going development
technology, apart from that moment this is the domain of technology information
is one of the most developed domains fast in this world ( Moravcik et al., 2012). �Need it a system that can
help in To do various profession Becomes more easy and fast, like the system
within the system, for example , which becomes more general in Public our
because diversity holder interest (De Lima & Fontoura, 2018). Application moment this Becomes demands how device the have quality and power high competitiveness. because
it, application need to be evaluated and measured as form for effort repair
quality ( Pamuji & Hartuti, 2018). �Beside that evaluation
device soft give description for propose on process improvement, reduction time
saving cost. Itself from context evaluation application play a role as tool
help test by quantity in level reception technology or device soft. because that , question will appear is factor what can influence
level usage. Because that so make it a method evaluation device soft use User
Acceptance Testing (UAT) scheme for answer the extent to which the quality
possessed by the tutorial application face face that
has made.
By technical, existing system made in form application face
-to-face tutorial advance web -based and android capable give alternative
solution for the related Universitas Terbuka implementation, monitoring and accuracy
of attendance data. Application made in online form for information campus
allow student for get layout _ planning more education _ good (Malhotra et al., 2020) . The advantage, the officers in charge answer on tutorial
activities can each other monitor During activity ongoing and capable give
accuracy timetable presence. On system before, for tutorial activity still use
method conventional or manually. Weaknesses, no there is description digitally
related to the process.
Studies this aim for propose use technique
testing device soft as evaluation system at the Universitas Terbuka on
face-to-face tutorial services face. Testing technique includes User Acceptance
Testing (UAT), p this meant for see how far is the system could function and
fulfill needs users ( Afrianto
et al., 2021) . Use technique testing device soft aim
increase index satisfaction user in use face-to-face tutorial system face.
Besides that, system could used as tool assist in
learning system activities . Destination user device
real soft _ test device soft for ensure could handle required task _ in real
world scenario (Mohamad
& Yassin, 2016) . Existence technique testing device
proposed software , it is hoped capable increase
quality service system learning face-to-face tutorial service advance so that
index satisfaction user experience increase.
METHOD
On study this
method used is technique testing dynamic as system testing the method used is
for ensure quality and validate device soft ( et al., 2017) . test case is what becomes base testing for knowing that
components used already in accordance with needs functional system and know
level success from function application because technique testing the the more important for arrange repeat test case in accordance
to goals that have been determined (Luo et al., 2019) . Then next testing device soft with use technique user acceptance
testing (UAT) survey method.
User acceptance testing (UAT) is a test that is intended outside the
system, namely the user. Testing is aimed at users related to face-to-face tutorial activities then. The purpose
of user acceptance testing is to determine the feasibility of the software.
Technically, white box testing and black box testing are sufficient to
determine whether the software is feasible to release to users. However, the
existence of UAT can detect unknown errors in white box and black box testing , Verification and Validation is the process of checking that
system device soft Fulfill specifications and meet proposed goal at the
beginning (Larrea, 2017) . In User acceptance testing (UAT), it is
carried out using a survey method, namely by distributing questionnaires to
users ( Tutors, officers , students ) who have previously been given tutorials on
using the application. The questionnaire model uses a Likert scale
with a scale of 5, namely strongly agree; agree; neutral/undecided; disagree;
strongly disagree. UAT is used to answer software problems around the metric
system; usability; satisfaction and some settings on each function/feature.
RESULTS AND DISCUSSION
In the UAT process is carried out inspection and testing to
results device software made. Checked things covering existing in requirements
document and already there is in device software that will tested. Next the
items that will be checked the then tested to know is could Fulfill needs
users. For more explained, below is a process or stages from the user
acceptance test (UAT) conducted in the study this.
A.
Develop a UAT
plan
UAT test plan
is create a strategy that will used for verify and confirm application Fulfill
loaded. In stages this involve composing documents, test scenarios, test cases
approach, schedule testing, date, environment, actors, roles and
responsibilities replied the actor.
Table
1. actors and responsibilities answer
|
UAT Team Roles &
Responsibilities |
||
|
Name |
Roles |
Responsibilities |
|
Erman Arif |
Administrator |
Ensure application walk with good |
|
Sucipto |
UPBJJ Officer |
To do test module |
|
Dedi |
Lecturer |
To do test module |
|
Reny Andriyanty |
student |
To do test module |
|
Umar |
student |
To do test module |
B.
UAT Design
Criteria collected receipts _ from
user end used in step this. Based on criteria plan beginning development
system, in charge for make criteria is QA (Quality assurance) team with method
give user list of UAT test cases. This process could seen in the table following this.
Table
2. UAT Design
|
UAT Scope Planning (In
Scope � Out of Scope) |
|
|
UAT - In Scope |
UAT - Out of Scope |
|
1.
Login Form 2.
Forgot
Password 3.
Dashboard
Module 4.
Biodata
module 5.
Permission
module class 6.
Pay module 7.
Registration
module 8.
Schedule
module 9.
Quantity
module class 10.
User
management module |
1.
Web Hosting
and Domains 2.
Program
Source Code 3.
Engine
Database 4.
Setup
Module |
C.
UAT Test
Execution
User
Acceptance Testing (UAT) is a testing involving_user
end. Goal for knowing what is system do and profit what do you get from system
based on corner look user end (end user). UAT testing involves a number of
respondent face tutorial officer face. Test conducted in the Universitas
Terbuka environment with previously given a tutorial on how to use face-to-face
tutorial system advance web and android based. Respondents_answer
questionnaire after using tutorials. In table 1 presents Theory survey a
questionnaire consisting of of 4 parts: setting function ; system metrics; usability; and user satisfaction
Table
3. material survey questionnaire
|
No |
Theory |
|
1 |
Log
in application |
|
2 |
Bio
settings |
|
3 |
Arrangement
tutorial scheduling |
|
4 |
Arrangement
presence presence |
|
5 |
appearance |
|
6 |
App
responsive |
|
7 |
Data
consistency |
|
8 |
performance |
|
9 |
Easy
used |
|
10 |
Speed
access |
Materials
1-4 are the focus of setting functions and system matrices, which include
question how to log in application, bio settings, settings schedule scheduling,
and setting attendance input presence. Whereas for material 5-10 is the focus
on usability and user satisfaction, which includes question about appearance,
responsiveness, performance, convenience and speed access.
Table
4. results evaluation
|
Theory |
SA |
A |
N |
D |
SD |
|
Function
settings |
5 |
10 |
2 |
0 |
0 |
|
System
matrix |
5 |
10 |
2 |
0 |
0 |
|
usability |
10 |
5 |
5 |
0 |
0 |
|
user
satisfaction |
5 |
10 |
0 |
0 |
0 |
SA:
strongly agree
A:
agree
N:
neutral/undecided
D:
disagree
SD:
strongly disagree
Table
2 is UAT results involving officer related for face-to-face tutorial activities
advance in evaluate system. A number of respondent To
do evaluation in charging questionnaire. Obtained results questionnaire in form
likert scale that will analyzed in a graph.

Figure
1. Graphics UAT results
D.
Confirmation
goal fulfilled _
UAT examiner
must confirm various destination applications that have been fulfilled use
document UAT testing. Staged this, confirm must conducted for ensure that
product the has considered worthy for launched to environment production or the
official website of the Universitas Terbuka. Output result for UAT testing is a
test plan, UAT scenario, test cases, and test results. Criteria that must be
considered as UAT output before device soft move to environment production is
no there is failure system and process work with good. Following is example UAT
results on one of the module in the application.
Table
5. results of the UAT module Login form
|
UAT Test Results |
|
|
||
|
ID |
Test Cases |
Pass/Fail |
Tested By |
Date Tested |
|
1.1 |
Login Form Test Procedures : - Register via _ face tutorial app advance - Forgot password - Login using user _ Expected
Results: - Register successfully - Password sent by email - Enter the hall application |
|
|
mm/dd/ yyyy |
E.
Signature UAT
process report
After succeed complete testing and
completion problem team by general, then the UAT test is considered succeed
show reception application. If the user end in Thing this are Tutors, Students,
and Officers has accept device soft, meaning device
soft the has Fulfill requirements that have been
determined and ready launched to environment production and sign hand from
various party could done.
Table
6. sign form design UAT hand
|
4. Document Signatures |
|||
|
Role |
Name |
Signature |
Date |
|
Administrator |
Erman Arif |
|
|
|
UPBJJ Officer |
Sucipto |
|
|
|
Lecturer |
Dedi |
|
|
|
student |
Reny Andriyanty |
|
|
|
student |
Umar |
|
|
CONCLUSION
Based on results studies evaluation application use the User
Acceptance Testing (UAT) method, can taken a number
of conclusion that is Making application Face -to-face
Tutorial Advance (TTM) really helps the student system process at the Universitas
Terbuka, hal the seen on the graph UAT results are 25
respondents rate strongly agree, 35 respondents evaluate agree, 9 respondents
choose neutral, and not respondents who rate no agree. Besides that found On app this still there is a number of deficiency
because still found less result _ good moment system testing on the web and
android mobile.
REFERENCES
Afrianto, I., Heryandi, A., Finandhita, A., & Atin, S.
(2021). User Acceptance Test For Digital Signature Application In Academic
Domain To Support The Covid-19 Work From Home Program. IJISTECH
(International Journal of Information System and Technology), 5(3),
270�280.
De Lima, R. M., & Fontoura, L. M. (2018). An approach for
system of systems requirements management. Proceedings of the International
Conference on Software Engineering and Knowledge Engineering, SEKE, 2018-July(March
2019), 161�164. https://doi.org/10.18293/SEKE2018-178
Hedaoo, A. H., & Khandelwal, A. (2017). Study of Dynamic
Testing Techniques. International Journal of Advanced Research in Computer
Science and Software Engineering, 7(4), 322�330.
https://doi.org/10.23956/ijarcsse/v7i4/0136
Larrea, M. (2017). Black-Box Testing Technique for
Information Visualization. Sequencing Constraints with Low-Level Interactions. Journal
of Computer Science and Technology (La Plata), 17(1), 37�48.
Luo, Q., Moran, K., Zhang, L., & Poshyvanyk, D. (2019).
How Do Static and Dynamic Test Case Prioritization Techniques Perform on Modern
Software Systems? An Extensive Study on GitHub Projects. IEEE Transactions
on Software Engineering, 45(11), 1054�1080.
https://doi.org/10.1109/TSE.2018.2822270
Malhotra, R., Kumar, D., & Gupta, D. P. (2020). An
android application for campus information system. Procedia Computer Science,
172, 863�868. https://doi.org/10.1016/j.procs.2020.05.124
Mohamad, R., & Yassin, N. M. (2016). Comparative
Evaluation of Automated User Acceptance Testing Tool for Web Based. International
Journal of Software Engineering and Technology, 2(2), 1�6.
Moravcik, O., Petrik, D., Skripcak, T., & Schreiber, P.
(2012). Elements of the Modern Application Software Development. International
Journal of Computer Theory and Engineering, January, 891�896.
https://doi.org/10.7763/ijcte.2012.v4.601
Nur Fauzi, A. M., Triayudi, A., & Sholihati, I. D.
(2022). Mengukur Tingkat Kepuasan Pengguna Aplikasi Kearsipan Menggunakan
System Usability Scale Dan Pieces Framework. JIPI (Jurnal Ilmiah Penelitian
Dan Pembelajaran Informatika), 7(1), 231�239. https://doi.org/10.29100/jipi.v7i1.2452
Pamuji, A., & Hartuti, P. M. (2018). Evaluasi Perangkat
Lunak Aplikasi Shipment Tracking Pada Tingkat Penerimaan Pengguna Akhir. Simetris:
Jurnal Teknik Mesin, Elektro Dan Ilmu Komputer, 9(2), 833�840.
https://doi.org/10.24176/simet.v9i2.2411
|
|
|