ios app testing help manual

Upload: jaimin

Post on 01-Jun-2018

222 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/9/2019 IOS app testing help manual

    1/13

    Software Testing help manual for iOS

    Start Date 22/12/14

    Subject Software Testing help manual for IOS

    developers

    Platform iOS

    Created by: Jaimin Limbani

    Email-id [email protected]

    Options/

    EventsDos Dont s

    App launch

    Launch Event

    Launch app and Go to HOME -> again

    launch app from Home screen -> It

    should resume app from that point

    where it was suspended.

    -

    For the first time use , If user don't

    allow some functions when app ask

    for permission, and next time when

    user try to use the same

    function(without changing the

    permission from setting) app

    should not crash.

    -

    According to requirement,

    applications may be designed to reset

    to the initial condition on relaunch.

    -

    User Sign Up

    & Verification

    Sign up for app

    According to requirement , All fields

    should be present

    According to requirement, any field mu

    not miss from sign up screen.

    According to requirement , All

    mandatory field should be mentioned

    with different sign like *,# etc..

    Any unwanted blank/white space in field

    should not create validation error.

    According to requirement, all check

    box and radio button should be there

    Validation from the server and local mobi

    app must not different.

    According to requirement , Submit/OK

    , Reset and cancel buttons may bethere.

    Left all fields and click on Submit/OK butto

    -> it should not submit the form.

    User should be signed up successfully

    , if all the mandatory fields filled with

    correct information

    Left any of the mandatory field and tap o

    Submit button -> Form should not submit

    According to requirement,all text field

    should bound with upper and lower

    boundary value .

    Quickly tapping on submit button multip

    time, should not keep sending same form t

    Server.

    mailto:[email protected]:[email protected]:[email protected]
  • 8/9/2019 IOS app testing help manual

    2/13

    According to requirement, All the date

    pickers , check box and radio button

    should be validated.

    -

    Email id field should be validated -

    After successful sign-up -> it should

    display message

    -

    Reset button should reset all the

    fields.

    -

    Cancel button should dismiss the

    registration process

    -

    Log-in Pages

    According to requirement , User-name

    may be designed uniquely i.e. If

    Requirement is to combination of

    alphabetical and numeric character

    then it should be like abc123.

    User-name should not left blank

    User should be logged in if user-nameand password are entered correctly.

    User-name should not start with or contaany symbols

    Message should be appear after

    successful log-in.

    User-name field should not accept mo

    than maximum characters

    User-name field should not accept less

    than minimum characters

    User-name field should not accept less tha

    minimum characters

    - Password field should not left blank

    - Password should not contain spaces and

    period.

    - Password field should not accept more tha

    maximum characters.

    - Password field should not accept less thanminimum characters.

    - If password or user-name do not match

    above criteria then it should display

    message for all cases.

    Password

    Protected(Wake

    up security)

    Apps -> Log-in

    User types correct password and it

    allow user to use the app.

    User types incorrect password and it won

    allow user use the app.

    User go to home by Pressing HOME

    button and go return back to the

    app from recently opened apps in BG -

    > It should ask for password.

    If Password is not correct -> It shou

    display message or toast.

    Forgot

    Password

    User types correct mail id and it

    matches in database -> It will send the

    request for new password.

    User types incorrect mail id or other deta

    and it won't send request for ne

    password.

    If it sends request for new password

    successfully -> It should display

    If email id is wrong -> it should displa

    message or toast.

  • 8/9/2019 IOS app testing help manual

    3/13

    message .

    Log-out

    User tap on Log-out button -> should

    be redirect to Log-in page

    If Connection is lost or Offline -> It shou

    not ask user for Internet connection for Lo

    out process and redirect to log-in screen.If connection is lost before user tap on

    log-out -> it should redirect user to

    Log-in page.

    -

    Navigation &

    BarsStatus Bar

    According to requirement, It may be

    hide also.

    -

    According to requirement, Status bar

    style also can be changed.

    -

    Navigation

    Drawer/Side

    panel

    It should be expand by swiping left to

    right from the edge of the screen .

    It should not closed by again swiping from

    left to right.

    It should be closed by touching any

    content outside the drawer.

    Once user choose any options from Drawe

    -> If it redirect to any other screen then

    should be closed automatically.

    It should be closed by swiping to the

    left anywhere on the screen .

    Small screen device , it is not easy to tap o

    the Navigation Drawer button.

    Navigation Drawer should work

    smoothly for Expand and collapse

    view -> It can be used to reach more

    current place in app easily.

    Assigned title name and icons,in Drawe

    should not be different than requirement.

    Navigation Drawer icon should be

    easily tap-able

    If possible then action bar button shou

    not enabled when User opens Navigatio

    Drawer.

    - If the user navigates away from a view wit

    selected content, Selection should b

    removed all the content before navigatin

    to the new view.

    - If user tap on any content outside th

    drawer to close it -> it should not allow t

    tap on that particular content.

    Navigation Bar

    and Buttons

    According to requirement, Navigationbar should be customize background

    color.

    -

    According to requirement,

    Background image can be set as

    Navigation bar.

    -

    According to requirement, Buttons

    can set to left or right of the

    -

  • 8/9/2019 IOS app testing help manual

    4/13

    navigation bar.

    Drop-downs,

    buttons and

    Text fields

    Text Fields

    According to requirement , there may

    be validation for special characters or

    numbers or alphabets etc..on textfields.

    Text fields should not accept invalid inputs

    According to requirement , size may

    be limited for text fields.

    -

    According to requirement, there may

    be restriction for copy/paste on it.

    -

    Radio button

    and Check-box

    For custom radio button and Check-

    box -> size should be big enough for

    tapping.

    Custom radio and check-box should no

    take time in response.

    Custom check boxes -> Select All box

    should change the state to markedautomatically , if all the options below

    are selected manually.

    -

    Custom check boxes -> If all options

    are selected and user unchecked an

    option from list, Select All box should

    be turn to unchecked.

    -

    Drop-down

    menu

    According to requirement , default

    value should be selected.

    For medium and small size character lengt

    -> any character should not be missed.

    According to requirement , values

    should be sorted properly.

    -

    For very long Character length ->

    maximum number of characters

    should be displayed.

    -

    According to requirement, Drop-down

    box should be bounded by size.

    -

    Picker

    Picker should provide time and date

    etc... in correct format.

    -

    According to requirement, there

    should be validation on picker for time

    , date etc..

    -

    Uploads and

    DownloadsUpload Images

    It should upload image to server

    successfully.

    It should not upload unwanted extension

    files.

    It should display thumb image without

    scratching.

    According to requirement, image siz

    should not greater than maximum size.

  • 8/9/2019 IOS app testing help manual

    5/13

    According to requirement, There may

    be option to remove images from

    thumb.

    -

    Uploaded image path should be

    proper or valid.

    -

    Image change functionality shouldwork based on requirement. -

    Image upload progress bar should

    display.

    -

    Download in

    app

    App should handle the pause , resume

    and stopping of resource file

    downloading to the phone.

    In case of , Network lost or switchin

    network while downloading content in ap

    ->It should not ask user to download aga

    or should not create any other error.

    Sharing

    Mail

    Attachments

    According to requirement , mail id

    might be auto attached to Mail idfield.

    After sending mail , it should not stay in th

    same screen.

    For Mail functionality , App should

    redirect user to list of all Mail sender

    app or defined Mail sender app.

    All files/texts that user trying to sen

    through mail , should not go missing o

    email app screen.

    After sending mail , it should display

    message whether it is successful or

    not.

    It should not allow to send file greater tha

    25 MB, or display proper message for it.

    File Export

    Export as excel

    File extension of the exported file

    should be proper.

    It should not stop exporting if file size is to

    large.

    File name for the exported Excel fileshould be as per the standards, like

    File contain Time-stamp or Date-

    stamp etc. then name should replace

    by actual Date-stamp or Time-stamp

    Special characters and signs etc.. should nobe missed in exported files.

    File should have proper column name. For numeric value, Formatting should no

    change.

    Excel file data should be formatted

    properly with header and footer text,

    date, page numbers etc. values for all

    pages.

    Sorting value should not change in exporte

    files.

    Maps

    Maps

    Map should be load completely on

    app screen.

    Pin size and color should not be differen

    than requirement.

    According to requirement, pin should

    be drop at exact location

    -

    According to requirement, there may

    be Zoom in button, Zoom out button

    and scroll bar, and all three should

    -

  • 8/9/2019 IOS app testing help manual

    6/13

    function properly.

    Notifications

    andMessages

    Notification

    According to requirement, it may

    work in BG also when user is playinggame or watching videos etc...

    It should not stop working when app

    closed.

    It should work in multiple time zone

    also.

    App should not display same notificatio

    again and again.

    It should be tap-able or open new

    activity.

    If app is open and notification appear o

    the app screen then it should not appea

    again as notification.

    If there are more number of message

    or texts sent then it should display

    latest message(s) on the notification.

    -

    If app is open and notification comes -

    > it should display in app screen.

    -

    Confirming

    message &

    other messages

    and labels

    App should ask the user to verify that

    they truly want to proceed with an

    action they just invoked.

    Some action should not taken withou

    warning or messages like Delete,Exit etc.

    It should display with warning or

    message.

    There should be no grammatical or spellin

    mistakes in Splash / Title / Logo / Loadin

    Screen,About screen,Help/Instruction

    Screen,Main Menu and all its subsidia

    menus and other labels...etc

    - Button name should not mismatch wit

    event of the button.

    Acknowledging

    App should display acknowledge text

    to inform the users that the action

    they just invoked has been completed.

    -

    According to requirement , It can be

    present with Undo option also.

    -

    App setting

    and

    managementManage

    Lengthy

    Operations

    According to requirement , any web

    related operation that is taking more

    than expected time should ask user

    with proper message and 'Cancel'option.

    For web related operation, if app is kee

    loading for long time then operation shou

    be aborted with proper message.

    App Setting

    If app is launched with known setting -

    > user changed setting in App menu

    like volume,orientation or language

    etc... -> when user Exit or Minimize

    app , it should restore previous

    According to requirement, Setting may o

    may not change when user restart the app

  • 8/9/2019 IOS app testing help manual

    7/13

    setting.

    It should save all the setting on Exit of

    app.

    -

    Memory-File

    System

    App should handle any type of

    memory exception properly.

    While app is writing data to file system ->

    app closed, it should not crash and any dat

    should not lost.

    It should display warning when app is

    trying to store data in file-system and

    memory space is not sufficient for it.

    -

    Message

    Exchange Send or receive

    messages inapp

    Message should be in proper format

    while sending or after receiving it.

    After sending message -> It should not tak

    more time than expected time.

    On message receive, it should notifyuser or it should launch app with

    sound.

    Any content should not be missing when reaches to receiver side.

    Language

    Languages

    According to requirement , App

    should have all required languages.

    It should not change last selected languag

    again if user Exit app and again opens it.

    If language in application set as auto-

    detected -> App should set language

    according to phone's language

    When user change language -> It should no

    restart app.

    When user change language manually

    in app -> App should change it quickly

    , with no time delay.

    -

    Database

    Database

    Correct data must get saved in

    database upon successful page

    submit.

    Null value should not submit in colum

    which doesn't allow it.

    Data should be stored in either single

    or multiple column based on design.

    Data must not committed to databas

    before the operation completed.

    Table should have primary key

    column.

    Null values should not be allowed fo

    Primary key column.

    Add/Update operation log should be

    added.

    Input data must not truncated while saving

    Valid database name should beassigned to it. -

    All the table constraint like primary

    key, foreign key etc.. are implemented

    correctly.

    -

    Radio button and drop-down list

    options are saved correctly in

    database.

    -

  • 8/9/2019 IOS app testing help manual

    8/13

    Data should be rolled back in case of

    failed transactions

    -

    Security

    Security

    All credentials should be transferred

    after encryption.

    Error messages should not reveal an

    sensitive information

    Log-out functionality should functionproperly. Page crash should not reveal application oserver info

    File upload functionality should use

    file type restrictions.

    Sensitive fields like passwords and cred

    card information should not have aut

    complete enabled

    Password and other sensitive fields

    should be masked while typing.

    -

    App password should be combination

    of the alphabets, number and special

    characters

    -

    Upgrade

    Upgrade an app

    While upgrading an app, data andsetting of old app should be

    preserved.

    After upgrading an app, any type of datshould not be missed.

    App should upgrade path from all

    previous version.

    After upgrading an app, user setting shou

    not removed/reset.

    According to requirement , push

    notification may display on

    notification bar.

    After upgrading an app,Credential shou

    not be removed.

    Upload to

    iTunes

    Adding app to

    the iTunes

    App name must be unique and should

    not match with another app on the

    store.

    -

    SKU number should be unique among

    your apps, it should include include

    letters, numbers, hyphens, periods,

    and underscores.

    Default Language,App Name, SKU an

    Bundle ID should not entered incorrectly.

    Supported URL should be valid. -

    Description should be added properly

    with no spelling or grammatical

    mistake.

    -

    Large App Icon (1024 x 1024 JPG, TIFF,

    or PNG ) - this image is for displaying

    in iTunes and on the App Store. It

    should match the icon in your app.

    -

    Price and release date should be

    entered properly .

    -

    Version Name and Copyright info of

    app should be entered properly.

    -

    Valid e-mail address, and contact

    phone numbers and a name should be

    -

  • 8/9/2019 IOS app testing help manual

    9/13

    entered for app reviews information.

    Touch

    screensSingle Tap on

    screen

    It should trigger the default

    functionality.

    Tap on a object and swipe finger out of it ,

    should not trigger any functionality.

    - Tap on a object and finger swiped from onobject to another object, it should no

    trigger the functionality of second object.

    Long Press/tap

    Pressing and holding an item will bring

    up a Pop menu in the middle of the

    screen.

    It should not trigger the defau

    functionality like Single tap.

    Enter the selection mode to select

    different texts/items.

    -

    Swipe or Drag

    Scrolls overflowing content, or

    navigates between views in the samehierarchy.

    It should not open context menu in th

    middle of the screen.

    Swipes can be quick and should affect

    even after the finger is picked up.

    Swiping left/right should not be difficult t

    open the other options.(Time interval nee

    to manage properly)

    Swipe left and right -> can be used to

    change the tabs.

    -

    Multiple Tap on

    Icons/Buttons

    Tap with two finger on screen at two

    different location -> it should trigger

    the functionality of firstly tapped

    icon/button.

    Tap and hold on a object and tap o

    another icon/button with another finger

    it should not trigger the event of secon

    icon/button.

    - Tap with two finger on screen at tw

    different location -> it should trigger th

    functionality of firstly tapped icon/butto

    and should not open both one afte

    another.

    Double Tap

    For nested views, scales up the

    smallest target-able view, or returns it

    to its original scale.

    -

    Pinch Zoom

    In/Out

    Two or more finger to zoom In/Out

    contents

    It should not work as Swipe

    Network

    Networking

    Only in Wi-Fi network it should work

    fine.

    Switching between network should no

    cause app crash.

    Should work in only 3G connection Without Sim-card , app should not sto

    working.

  • 8/9/2019 IOS app testing help manual

    10/13

    Should work in only 2G connection -

    In Airplane mode (or all connections

    disabled)

    -

    It should work fine using the network

    through a USB connection to a PC

    -

    It should work fine in case of usermoves to Out of network.

    -

    Should Work fine in device with no

    SIM card.

    -

    It should work fine if user walk out of

    Wi-Fi range so the connection

    automatically switches to 3G/2G (for

    example, in a large building like a

    hospital or airport, or outdoor

    -

    It should display message ,if

    connection is lost.

    -

    The Application will work until timeout and then give an error message to

    the user indicating there was an error

    with the connection

    -

    Other Hard

    wares

    Sensors

    Gyroscope or Accelerometer Sensors:

    While changing the position, angle

    and alignment of the device , it should

    move or navigate in app.

    -

    Proximity sensors: For phone call or

    auto screen lock , it should turn off

    display at right time and when objectremoved from over the sensors, it

    should turn on the screen

    automatically.

    -

    GPS sensors: In MAP related app, it

    should detect exact location and app

    should display it in time.

    GPS sensors: According to requirement,

    user is out of some specific area,then ap

    should display default location as curren

    location.

    Ambient Light Sensor: According to

    requirement, It should be enabled and

    disabled the sensors e.g. For some

    games , full brightness is mandatory

    -

    Compass sensor: In MAP related app,

    It should point toward right direction

    in right time in user's app.

    -

    Battery Usage

    Use of JPEG images can slow down

    battery draining instead of PNG

    images. JPEG compresses images

    GPS and blue-tooth should be turn t

    disabled when there is no more use of it.

  • 8/9/2019 IOS app testing help manual

    11/13

    better and is faster to render, and is

    therefore more energy efficient.

    Background service should be disabled

    when device lose connectivity.

    -

    Developers should set frequency ofbackground updates to reduce the

    effect of those updates on battery life,

    refresh rate should be maximum

    whenever the device is connected to a

    wall charger and if the device is

    discharging, reducing your update rate

    helps prolong the battery life.

    -

    Background updates rate can be set

    according to battery level changes.

    -

    Interruptionsand Crashes.

    Phone calls or

    Other

    Interruption

    If user receive or dial call while usingapplication -> App should be paused

    and resume after end the call.

    App should not be hanged after receiving odialing a call.

    Text messages, Voice-mail

    notifications, Calendar events, Social

    media notifications (Facebook,

    Twitter, etc), Alarm clocks and Low

    battery notification -> App should

    work fine after such interruption

    App should not be hanged or data loss afte

    interruption of Text messages, Voice-ma

    notifications, Calendar events, Social med

    notifications (Facebook, Twitter, etc), Alar

    clocks and Low battery notification.

    App Crash

    Programmer should Handle the a poor

    network connection,it can force anapp crash as well.

    When a programmer references an object

    or variable that doesn't exist, technicallycalled a null-pointer error.

    For some low memory devices -> app

    can crash easily compare to high end

    devices.

    Programing Errors in the coding that

    triggers invalid and unauthorized

    instructions can cause app crash.

    UI & screens

    App Fonts &

    Other Contents

    According to requirement , Fonts size

    and style both should be proper.

    Larger fonts should not increase numbers

    lines of label/texts or should not create th

    issues with device width.

    Font family,size and style should be

    proper, and clearly readable on all

    resolution screens, available inmarket.

    Choosing a different font family, size, o

    style should not affect the appearance an

    usability of your application.

    According to design ,all the content

    should be managed properly

    There should not overlapping issues fo

    small size devices

  • 8/9/2019 IOS app testing help manual

    12/13

    UI

    With change in orientation ->

    Extended status bar should be re-sized

    according to requirement.

    -

    If there is any animation then it

    should run smoothly.

    -

    All images should be fit both type of

    device (Retina and Non Retina

    displays).

    -

    If there is any web view it should fit

    to screen horizontally.

    -

    Orientation

    While changing orientation -> Design

    should be fit to changed environment

    If requirement is specified as landscape

    portrait then it should not chang

    orientation

    According to requirement , it may be

    locked by code also

    -

    App should change orientation , if

    user rotate device

    -

    Screen Timeout

    According to requirement , Screen

    light may be dimmed or automatically

    turn off

    If requirement is to keep lights on -> ap

    should not allow to automatically turn o

    the light.

    Splash screen

    According to requirement , splash

    screen should display/run for given

    time and then next screen should

    appear in time.

    App should not take extra time to presen

    splash screen.

    - User tap on Home button on splash screen

    > App should not crash or restart.

    Time-Out

    Time-out

    According to requirement, App log-

    in/out function can be set to specific

    timeout for security purpose.

    If app is idle then it should not be long tim

    for secure app like banking app.

    While uploading or downloading data

    ,if it takes more time due to

    interruption or lost network, it should

    be timeout.

    If server is responding very slow or due t

    any other interruption there is any issu

    then it should not be keep loading, it shou

    be timed out

    According to requirement, app can be

    designed so that user redirect to some

    specific screen after specific time

    interval in ideal condition.

    Cloud

    Sharing Cloud Sharing

    According to requirement , app may

    used store/share data to clouds like

    Drop-box, Box.net, SugerSync etc.

    -

  • 8/9/2019 IOS app testing help manual

    13/13

    While uploading or Downloading data

    to cloud, it should display progress

    While uploading or Downloading data

    user should not allow to do any othe

    action.

    After redirect to cloud app, Log in/out

    functionality should work properly.

    After redirect to cloud from the app

    While logging in/Out , app should not crash

    While Downloading data from cloud it should ask to store data on

    desired location.

    -

    If in the same file/Folder user wants

    to copy data, and a file with same

    name/data is already exist there it

    should inform user about it.

    -