Word Hunt Coding Challenge evaluation criteria

Edit Subject

what is the criteria for evaluation of the Word Hunt coding challenge?? Please, can somenody explain what points are taken into account while evaluating a particular solution submitted by a user??

12 people have
this question +1

0

Edit

Delete

Remove

Official

Chris Grebeldinger June 21, 2011 07:20

If it's automated then I assume it's some combination of runtime, memory usage and code size, but that would give a big advantage to compiled languages.

Is it worth re-coding a python solution in C to get better performance ?

good answer! good answer! (undo)
- view 7 more comments
- Albert Lai June 21, 2011 18:27
  
  Can somebody from Gild comment on this? Is the scoring evaluation language neutral or is it easier to score better with specific languages?
  
  Edit
  
  Delete
  
  Remove
- Cancel
- Jack Sparrow June 21, 2011 18:44
  
  I guess they are not evaluating based upon the algorithm(really stupid of them).
  I have a damn efficient solution and it scored 730 points whereas a pure brute force scored 737 points. BTW, the problem is very similar to this one: https://www.spoj.pl/problems/WPUZZLES/ . As you can see that with pure brute force it's not possible to solve the Question. Mine first code (with 730 pts.) was able to pass the problem in link given and yet scored less than brute force solution(which is very inefficient). Its strange and seems that the test cases are very weak. You only need luck (no intelligence) to win such competitions :)
  
  Edit
  
  Delete
  
  Remove
- Cancel
- Jack Sparrow June 21, 2011 18:44
  
  *evaluated
  
  Edit
  
  Delete
  
  Remove
- Cancel
- Chris Grebeldinger June 21, 2011 19:32
  
  There should be a breakdown of the score components, even if it's just vague categories it would be better than a mystery score seemingly picked out of a hat.
  
  Edit
  
  Delete
  
  Remove
- Cancel
- Jim June 22, 2011 01:22
  
  A brute force Ruby solution scored me 695. The same code reworked in C++ seemed to run about 5x faster on the sample cases, and scored around 30 points higher. I'd say it's worth using a compiled language if you're serious about points.
  
  Edit
  
  Delete
  
  Remove
- Cancel
- This comment was removed on 2011-06-22.
  see the change log
- Federico (Employee) June 22, 2011 18:56
  
  Our approach is to evaluate the solutions based on real world conditions and needs. So the choice of technology and the implementation are an important factor in the quality of the solution. In the real world it could happen that a very well implemented good enough solution could perform better than a badly implemented efficient algorithm. Also, your solution should be thought based on the problem statement and the test cases provided, because *that* is the problem that we ask you to solve. We're not asking you to just open you CS book of algorithms and send us an implementation, we're asking you to understand the problem domain as well as the context (i.e. test cases) that your submission will be executed against. The only guarantee is that the private test cases will be similar (but not equal) to the debug test cases and that your solution will be executed in an isolated environment.
  
  Edit
  
  Delete
  
  Remove
- Cancel
- Jim June 22, 2011 21:15
  
  Spot on, Federico.
  
  Edit
  
  Delete
  
  Remove
- Cancel
- Chris Grebeldinger June 24, 2011 03:51
  
  Ok, but that doesn't answer the question of how the solution is scored.
  
  cpu time ? memory usage ? Any consideration of interpreted code vs. compiled code? After all in the real world we don't just care about performance, but also maintainability and how long it takes to implement.
  
  Edit
  
  Delete
  
  Remove
- Cancel
- Cancel
Edit Your Reply (some HTML allowed)
What's the status of this question?

If it's automated then I assume it's some combination of runtime, memory usage and code size, but that would give a big advantage to compiled languages. Is it worth re-coding a python solution in C to get better performance ?

How does this make you feel? Add Image

I'm
e.g. sad, anxious, confused, frustrated kidding, amused, unsure, silly indifferent, undecided, unconcerned happy, confident, thankful, excited
Cancel
I’m silly

0

Edit

Delete

Remove

Official

Madankumar Rajan June 22, 2011 03:40

Can someone explain me how points are given for coding questions?
I got higher points for a not so optimized code and when I resubmitted a ruby code with recursion and some optimizations and I got lower points. How is it possible?

This reply was created from a merged topic originally titled
Evaluation of coding questions.

Comment

good answer! good answer! (undo)
- Cancel
Edit Your Reply (some HTML allowed)
What's the status of this question?

Can someone explain me how points are given for coding questions? I got higher points for a not so optimized code and when I resubmitted a ruby code with recursion and some optimizations and I got lower points. How is it possible? This reply was created from a merged topic originally titled <a href="/gild/topics/evaluation_of_coding_questions/changes" target="_blank">Evaluation of coding questions</a>.

How does this make you feel? Add Image

I'm
e.g. sad, anxious, confused, frustrated kidding, amused, unsure, silly indifferent, undecided, unconcerned happy, confident, thankful, excited
Cancel
0

Edit

Delete

Remove

Official

lokesh755 June 22, 2011 03:40

HI sir,

I am very sure that you current evaluation scheme for word hunt coding challenge is not at all wise. And i know that you will reply saying that it is just your second contest and you are not clear about that and blah blah blah...

My suggestion or request is kindly run the programs sent by users over very large set of data and alot points accordingly.. If you run the program over large sets of data evaluation will be definitely easy for you. In the current evaluation you are considering some worst evaluation and increase score in terms of "7". That itself indicates that evaluation is not good.

in short again : run over very large set of data. In the current situation even brute force algorithm will work out.

This reply was created from a merged topic originally titled
PLEASE PLEASE PLEASE.... change the evaluation scheme of word hunt challenge.

good answer! good answer! (undo)
- view -1 more comments
- Balaji Sivanath June 22, 2011 05:45
  
  Y the increment is always 7. I did a very small modification,the increment was 7 in my points. Then i did big modification,reduced code length,removed repetition.. now the increment also "7" from old point. Expecting any reason why the increment or decrement like this.
  
  Edit
  
  Delete
  
  Remove
- Cancel
- Cancel
Edit Your Reply (some HTML allowed)
What's the status of this question?

HI sir, I am very sure that you current evaluation scheme for word hunt coding challenge is not at all wise. And i know that you will reply saying that it is just your second contest and you are not clear about that and blah blah blah... My suggestion or request is kindly run the programs sent by users over very large set of data and alot points accordingly.. If you run the program over large sets of data evaluation will be definitely easy for you. In the current evaluation you are considering some worst evaluation and increase score in terms of "7". That itself indicates that evaluation is not good. in short again : run over very large set of data. In the current situation even brute force algorithm will work out. This reply was created from a merged topic originally titled <a href="/gild/topics/please_please_please_change_the_evaluation_scheme_of_word_hunt_challenge/changes" target="_blank">PLEASE PLEASE PLEASE.... change the evaluation scheme of word hunt challenge</a>.

How does this make you feel? Add Image

I'm
e.g. sad, anxious, confused, frustrated kidding, amused, unsure, silly indifferent, undecided, unconcerned happy, confident, thankful, excited
Cancel

Reply to This Topic (some HTML allowed)
What's the status of this question?

How does this make you feel? Add Image

I'm
e.g. sad, anxious, confused, frustrated happy, confident, thankful, excited indifferent, undecided, unconcerned kidding, amused, unsure, silly

About this Question

Official Representatives

Products & Services

Tagged

The mood in here

Word Hunt Coding Challenge evaluation criteria

Edit Subject

About this Question

Official Representatives

Products & Services

Tagged

The mood in here

Word Hunt Coding Challenge evaluation criteria Edit Subject

Word Hunt Coding Challenge evaluation criteria

Edit Subject