THE EVALUATION OF WEB-BASED AND ANDROID FACE-TO-FACE TUTORIAL APPLICATIONS QUALITY USING THE USER ACCEPTANCE TESTING (UAT) METHOD

 

Erman arif1, Imelda Paulina Soko2

Information System Study Program/Universitas Terbuka Tangerang Selatan, Indonesia1

Educational Technology Education Study Program/Universitas Terbuka Tangerang Selatan, Indonesia2

e[email protected]1, [email protected]2

 


Received: 02-08-2022 ���������������� ��������������� Accepted: 10-08-2022 ������������������ ���Published: 20-08-2022����������������

 

ABSTRACT

Problems in the learning system at the Universitas Terbuka Basically no only focus against the tutorial in network only, but also on service help study stare advance that is not yet there is a system for monitor to what extent are the activities of the Tutorial Gaze Face (TTM). Studies this aim for measure how far is the quality Gaze Tutorial app Advance Web Based And Android.Methods used in measure quality application is use User Acceptance Testing (UAT) method. of several amount respondent could taken conclusion how far is the quality applications that have been done made in form prototype. After To do testing could taken conclusion that face tutorial app advance have attractive appearance, easy menus understood, content or Theory easy understood and understood, application this can also used as media in tutorial activities

 

Keyword: help study, evaluation, software quality, UAT.

 



Corresponding Author: Erman arif

E-mail: e[email protected]

https://jurnal.syntax-idea.co.id/public/site/images/idea/88x31.png

INTRODUCTION

Technology play role important to every field (Nur Fauzi et al., 2022). �With Keep going development technology, apart from that moment this is the domain of technology information is one of the most developed domains fast in this world ( Moravcik et al., 2012). �Need it a system that can help in To do various profession Becomes more easy and fast, like the system within the system, for example , which becomes more general in Public our because diversity holder interest (De Lima & Fontoura, 2018). Application moment this Becomes demands how device the have quality and power high competitiveness. because it, application need to be evaluated and measured as form for effort repair quality ( Pamuji & Hartuti, 2018). �Beside that evaluation device soft give description for propose on process improvement, reduction time saving cost. Itself from context evaluation application play a role as tool help test by quantity in level reception technology or device soft. because that , question will appear is factor what can influence level usage. Because that so make it a method evaluation device soft use User Acceptance Testing (UAT) scheme for answer the extent to which the quality possessed by the tutorial application face face that has made.

By technical, existing system made in form application face -to-face tutorial advance web -based and android capable give alternative solution for the related Universitas Terbuka implementation, monitoring and accuracy of attendance data. Application made in online form for information campus allow student for get layout _ planning more education _ good (Malhotra et al., 2020) . The advantage, the officers in charge answer on tutorial activities can each other monitor During activity ongoing and capable give accuracy timetable presence. On system before, for tutorial activity still use method conventional or manually. Weaknesses, no there is description digitally related to the process.

Studies this aim for propose use technique testing device soft as evaluation system at the Universitas Terbuka on face-to-face tutorial services face. Testing technique includes User Acceptance Testing (UAT), p this meant for see how far is the system could function and fulfill needs users ( Afrianto et al., 2021) . Use technique testing device soft aim increase index satisfaction user in use face-to-face tutorial system face. Besides that, system could used as tool assist in learning system activities . Destination user device real soft _ test device soft for ensure could handle required task _ in real world scenario (Mohamad & Yassin, 2016) . Existence technique testing device proposed software , it is hoped capable increase quality service system learning face-to-face tutorial service advance so that index satisfaction user experience increase.

 

METHOD

On study this method used is technique testing dynamic as system testing the method used is for ensure quality and validate device soft ( et al., 2017) . test case is what becomes base testing for knowing that components used already in accordance with needs functional system and know level success from function application because technique testing the the more important for arrange repeat test case in accordance to goals that have been determined (Luo et al., 2019) . Then next testing device soft with use technique user acceptance testing (UAT) survey method.

User acceptance testing (UAT) is a test that is intended outside the system, namely the user. Testing is aimed at users related to face-to-face tutorial activities then. The purpose of user acceptance testing is to determine the feasibility of the software. Technically, white box testing and black box testing are sufficient to determine whether the software is feasible to release to users. However, the existence of UAT can detect unknown errors in white box and black box testing , Verification and Validation is the process of checking that system device soft Fulfill specifications and meet proposed goal at the beginning (Larrea, 2017) . In User acceptance testing (UAT), it is carried out using a survey method, namely by distributing questionnaires to users ( Tutors, officers , students ) who have previously been given tutorials on using the application. The questionnaire model uses a Likert scale with a scale of 5, namely strongly agree; agree; neutral/undecided; disagree; strongly disagree. UAT is used to answer software problems around the metric system; usability; satisfaction and some settings on each function/feature.

 

RESULTS AND DISCUSSION

In the UAT process is carried out inspection and testing to results device software made. Checked things covering existing in requirements document and already there is in device software that will tested. Next the items that will be checked the then tested to know is could Fulfill needs users. For more explained, below is a process or stages from the user acceptance test (UAT) conducted in the study this.

 

 

 

 

A.      Develop a UAT plan

UAT test plan is create a strategy that will used for verify and confirm application Fulfill loaded. In stages this involve composing documents, test scenarios, test cases approach, schedule testing, date, environment, actors, roles and responsibilities replied the actor.

 

Table 1. actors and responsibilities answer

UAT Team Roles & Responsibilities

Name

Roles

Responsibilities

Erman Arif

Administrator

Ensure application walk with good

Sucipto

UPBJJ Officer

To do test module

Dedi

Lecturer

To do test module

Reny Andriyanty

student

To do test module

Umar

student

To do test module

 

 

B.      UAT Design

Criteria collected receipts _ from user end used in step this. Based on criteria plan beginning development system, in charge for make criteria is QA (Quality assurance) team with method give user list of UAT test cases. This process could seen in the table following this.

Table 2. UAT Design

UAT Scope Planning (In Scope � Out of Scope)

UAT - In Scope

UAT - Out of Scope

1.       Login Form

2.       Forgot Password

3.       Dashboard Module

4.       Biodata module

5.       Permission module class

6.       Pay module

7.       Registration module

8.       Schedule module

9.       Quantity module class

10.   User management module

1.       Web Hosting and Domains

2.       Program Source Code

3.       Engine Database

4.       Setup Module

 

 

C.      UAT Test Execution

User Acceptance Testing (UAT) is a testing involving_user end. Goal for knowing what is system do and profit what do you get from system based on corner look user end (end user). UAT testing involves a number of respondent face tutorial officer face. Test conducted in the Universitas Terbuka environment with previously given a tutorial on how to use face-to-face tutorial system advance web and android based. Respondents_answer questionnaire after using tutorials. In table 1 presents Theory survey a questionnaire consisting of of 4 parts: setting function ; system metrics; usability; and user satisfaction

 

Table 3. material survey questionnaire

No

Theory

1

Log in application

2

Bio settings

3

Arrangement tutorial scheduling

4

Arrangement presence presence

5

appearance

6

App responsive

7

Data consistency

8

performance

9

Easy used

10

Speed access

 

Materials 1-4 are the focus of setting functions and system matrices, which include question how to log in application, bio settings, settings schedule scheduling, and setting attendance input presence. Whereas for material 5-10 is the focus on usability and user satisfaction, which includes question about appearance, responsiveness, performance, convenience and speed access.

 

Table 4. results evaluation

Theory

SA

A

N

D

SD

Function settings

5

10

2

0

0

System matrix

5

10

2

0

0

usability

10

5

5

0

0

user satisfaction

5

10

0

0

0

 

SA: strongly agree

A: agree

N: neutral/undecided

D: disagree

SD: strongly disagree

 

Table 2 is UAT results involving officer related for face-to-face tutorial activities advance in evaluate system. A number of respondent To do evaluation in charging questionnaire. Obtained results questionnaire in form likert scale that will analyzed in a graph.

 

Chart, bar chart

Description automatically generated

Figure 1. Graphics UAT results

 

 

 

 

D.      Confirmation goal fulfilled _

UAT examiner must confirm various destination applications that have been fulfilled use document UAT testing. Staged this, confirm must conducted for ensure that product the has considered worthy for launched to environment production or the official website of the Universitas Terbuka. Output result for UAT testing is a test plan, UAT scenario, test cases, and test results. Criteria that must be considered as UAT output before device soft move to environment production is no there is failure system and process work with good. Following is example UAT results on one of the module in the application.

 

Table 5. results of the UAT module Login form

UAT Test Results

 

 

ID

Test Cases

Pass/Fail

Tested By

Date Tested

1.1

Login Form

Test Procedures :

-       Register via _ face tutorial app advance

-       Forgot password

-       Login using user _

Expected Results:

-       Register successfully

-       Password sent by email

-       Enter the hall application

 

 

mm/dd/ yyyy

 

 

E.       Signature UAT process report

After succeed complete testing and completion problem team by general, then the UAT test is considered succeed show reception application. If the user end in Thing this are Tutors, Students, and Officers has accept device soft, meaning device soft the has Fulfill requirements that have been determined and ready launched to environment production and sign hand from various party could done.

Table 6. sign form design UAT hand

4. Document Signatures

Role

Name

Signature

Date

Administrator

Erman Arif

 

 

UPBJJ Officer

Sucipto

 

 

Lecturer

Dedi

 

 

student

Reny Andriyanty

 

 

student

Umar

 

 

 

CONCLUSION

Based on results studies evaluation application use the User Acceptance Testing (UAT) method, can taken a number of conclusion that is Making application Face -to-face Tutorial Advance (TTM) really helps the student system process at the Universitas Terbuka, hal the seen on the graph UAT results are 25 respondents rate strongly agree, 35 respondents evaluate agree, 9 respondents choose neutral, and not respondents who rate no agree. Besides that found On app this still there is a number of deficiency because still found less result _ good moment system testing on the web and android mobile.

REFERENCES

Afrianto, I., Heryandi, A., Finandhita, A., & Atin, S. (2021). User Acceptance Test For Digital Signature Application In Academic Domain To Support The Covid-19 Work From Home Program. IJISTECH (International Journal of Information System and Technology), 5(3), 270�280.

 

De Lima, R. M., & Fontoura, L. M. (2018). An approach for system of systems requirements management. Proceedings of the International Conference on Software Engineering and Knowledge Engineering, SEKE, 2018-July(March 2019), 161�164. https://doi.org/10.18293/SEKE2018-178

 

Hedaoo, A. H., & Khandelwal, A. (2017). Study of Dynamic Testing Techniques. International Journal of Advanced Research in Computer Science and Software Engineering, 7(4), 322�330. https://doi.org/10.23956/ijarcsse/v7i4/0136

 

Larrea, M. (2017). Black-Box Testing Technique for Information Visualization. Sequencing Constraints with Low-Level Interactions. Journal of Computer Science and Technology (La Plata), 17(1), 37�48.

 

Luo, Q., Moran, K., Zhang, L., & Poshyvanyk, D. (2019). How Do Static and Dynamic Test Case Prioritization Techniques Perform on Modern Software Systems? An Extensive Study on GitHub Projects. IEEE Transactions on Software Engineering, 45(11), 1054�1080. https://doi.org/10.1109/TSE.2018.2822270

 

Malhotra, R., Kumar, D., & Gupta, D. P. (2020). An android application for campus information system. Procedia Computer Science, 172, 863�868. https://doi.org/10.1016/j.procs.2020.05.124

 

Mohamad, R., & Yassin, N. M. (2016). Comparative Evaluation of Automated User Acceptance Testing Tool for Web Based. International Journal of Software Engineering and Technology, 2(2), 1�6.

 

Moravcik, O., Petrik, D., Skripcak, T., & Schreiber, P. (2012). Elements of the Modern Application Software Development. International Journal of Computer Theory and Engineering, January, 891�896. https://doi.org/10.7763/ijcte.2012.v4.601

 

Nur Fauzi, A. M., Triayudi, A., & Sholihati, I. D. (2022). Mengukur Tingkat Kepuasan Pengguna Aplikasi Kearsipan Menggunakan System Usability Scale Dan Pieces Framework. JIPI (Jurnal Ilmiah Penelitian Dan Pembelajaran Informatika), 7(1), 231�239. https://doi.org/10.29100/jipi.v7i1.2452

 

Pamuji, A., & Hartuti, P. M. (2018). Evaluasi Perangkat Lunak Aplikasi Shipment Tracking Pada Tingkat Penerimaan Pengguna Akhir. Simetris: Jurnal Teknik Mesin, Elektro Dan Ilmu Komputer, 9(2), 833�840. https://doi.org/10.24176/simet.v9i2.2411

 

 

https://jurnal.syntax-idea.co.id/public/site/images/idea/88x31.png� 2022 by the authors. Submitted for possible open access publication under the terms and conditions of the Creative Commons Attribution (CC BY SA ) license ( https://creativecommons.org/licenses/by -sa / 4 .0/ ).